Jul 14 16:27:54.101370 ip-10-0-138-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 16:27:54.101382 ip-10-0-138-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 16:27:54.101389 ip-10-0-138-95 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 16:27:54.101646 ip-10-0-138-95 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 16:28:04.304100 ip-10-0-138-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 16:28:04.304118 ip-10-0-138-95 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 89b1f38ddb3e454f9fa0934f5a43aa34 -- Jul 14 16:29:44.140773 ip-10-0-138-95 systemd[1]: Starting Kubernetes Kubelet... Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.574708 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580116 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580140 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580145 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580149 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580152 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580156 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580158 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:29:44.757098 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580161 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:29:44.653639 ip-10-0-138-95 systemd[1]: Started Kubernetes Kubelet. Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580164 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580166 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580169 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580172 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580181 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580184 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580187 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580189 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580192 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580195 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580198 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580201 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580204 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580207 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580209 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580212 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580214 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580217 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580220 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:29:44.766712 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580223 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580225 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580228 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580231 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580234 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580237 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580241 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580244 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580246 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580249 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580251 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580254 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580258 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580261 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580265 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580270 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580272 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580276 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580279 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:29:44.768889 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580282 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580287 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580291 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580294 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580296 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580299 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580301 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580304 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580307 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580310 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580313 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580315 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580318 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580321 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580324 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580329 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580332 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580335 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580339 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:29:44.769730 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580342 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580345 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580348 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580350 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580353 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580356 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580359 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580362 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580364 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580367 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580370 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580373 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580375 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580379 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580381 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580384 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580387 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580391 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580394 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:29:44.770613 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580396 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580399 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580416 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580419 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580422 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580425 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580428 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580431 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580434 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580436 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580439 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580442 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580445 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580447 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.580450 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581287 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581295 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581299 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581302 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581305 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:29:44.771861 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581308 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581311 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581315 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581319 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581321 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581325 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581327 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581336 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581339 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581342 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581344 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581347 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581350 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581352 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581355 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581358 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581361 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581363 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581366 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:29:44.772991 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581369 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581372 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581375 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581378 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581381 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581384 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581387 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581389 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581392 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581395 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581397 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581415 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581419 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581421 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581425 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581428 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581430 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581433 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581435 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581438 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:29:44.773992 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581441 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581449 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581452 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581454 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581457 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581461 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581465 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581468 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581471 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581474 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581476 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581479 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581482 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581485 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581488 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581491 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581493 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581497 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581501 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:29:44.774662 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581504 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581508 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581511 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581515 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581517 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581521 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581525 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581528 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581534 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581537 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581539 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581542 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581544 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581547 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581549 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581558 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581560 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581563 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581565 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:29:44.775373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581568 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581570 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581573 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581575 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581578 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581581 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581583 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581585 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581588 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581590 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581593 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581595 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581598 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581601 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581603 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581606 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.581608 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582816 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582829 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582834 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:29:44.776036 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582839 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582846 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582853 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582865 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582869 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582874 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582878 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582882 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582911 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582916 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582920 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582924 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582928 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582932 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582937 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582941 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582951 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582958 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582963 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:29:44.777382 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582967 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582972 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582976 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582980 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582985 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582989 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582993 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.582998 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583005 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583018 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583023 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583028 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583033 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583040 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583046 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583051 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583055 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583060 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583064 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:29:44.778888 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583068 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583077 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583081 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583113 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583117 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583122 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583126 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583130 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583134 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583139 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583143 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583149 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583153 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583158 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583166 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583171 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583175 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583179 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583183 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583187 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:29:44.781239 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583191 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583195 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583199 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583203 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583208 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583212 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583216 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583226 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583438 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583448 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583452 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583455 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583458 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583464 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583469 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583472 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583476 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583479 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583485 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:29:44.783190 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583489 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583492 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583495 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583498 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583501 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583504 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583507 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583510 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583512 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583519 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583522 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583525 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583528 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583531 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583534 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583536 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583539 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583542 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.583545 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583623 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583634 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 16:29:44.786666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583642 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583646 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583651 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583654 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583659 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583664 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583667 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583670 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583674 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583677 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583680 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583684 2576 flags.go:64] FLAG: --cgroup-root="" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583687 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583690 2576 flags.go:64] FLAG: --client-ca-file="" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583693 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583696 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583704 2576 flags.go:64] FLAG: --cluster-domain="" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583707 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583710 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583714 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583720 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583724 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583727 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 16:29:44.789538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583730 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583733 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583737 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583740 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583743 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583746 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583749 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583758 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583765 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583768 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583771 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583774 2576 flags.go:64] FLAG: --enable-server="true" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583777 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583782 2576 flags.go:64] FLAG: --event-burst="100" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583785 2576 flags.go:64] FLAG: --event-qps="50" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583788 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583791 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583794 2576 flags.go:64] FLAG: --eviction-hard="" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583798 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583801 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583804 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583807 2576 flags.go:64] FLAG: --eviction-soft="" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583810 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583813 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583816 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 16:29:44.792241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583825 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583829 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583832 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583835 2576 flags.go:64] FLAG: --feature-gates="" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583840 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583843 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583846 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583850 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583853 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583856 2576 flags.go:64] FLAG: --help="false" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583859 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-95.ec2.internal" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583862 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583865 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583868 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583871 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583876 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583879 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583882 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583885 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583888 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583891 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583894 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583897 2576 flags.go:64] FLAG: --kube-reserved="" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583900 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 16:29:44.793074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583903 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583906 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583909 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583912 2576 flags.go:64] FLAG: --lock-file="" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583914 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583917 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583920 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583926 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583929 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583938 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583941 2576 flags.go:64] FLAG: --logging-format="text" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583944 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583948 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583951 2576 flags.go:64] FLAG: --manifest-url="" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583954 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583959 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583963 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583967 2576 flags.go:64] FLAG: --max-pods="110" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583970 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583973 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583976 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583979 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583982 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583986 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583990 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 16:29:44.793891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.583997 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584001 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584004 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584007 2576 flags.go:64] FLAG: --pod-cidr="" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584010 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584015 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584018 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584022 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584025 2576 flags.go:64] FLAG: --port="10250" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584028 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584030 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03792da319f8f7be8" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584034 2576 flags.go:64] FLAG: --qos-reserved="" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584037 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584040 2576 flags.go:64] FLAG: --register-node="true" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584043 2576 flags.go:64] FLAG: --register-with-taints="" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584047 2576 flags.go:64] FLAG: --registry-burst="10" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584050 2576 flags.go:64] FLAG: --registry-qps="5" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584058 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584061 2576 flags.go:64] FLAG: --reserved-memory="" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584065 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584069 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584081 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584085 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584088 2576 flags.go:64] FLAG: --runonce="false" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584091 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 16:29:44.796619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584094 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584098 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584101 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584103 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584106 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584112 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584115 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584118 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584121 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584123 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584126 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584129 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584132 2576 flags.go:64] FLAG: --system-cgroups="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584135 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584142 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584145 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584148 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584155 2576 flags.go:64] FLAG: --tls-min-version="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584158 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584161 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584164 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584167 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584170 2576 flags.go:64] FLAG: --v="2" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584174 2576 flags.go:64] FLAG: --version="false" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584179 2576 flags.go:64] FLAG: --vmodule="" Jul 14 16:29:44.797316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584189 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.584192 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584323 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584327 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584330 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584333 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584335 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584338 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584341 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584343 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584346 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584349 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584353 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584356 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584358 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584361 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584364 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584366 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584369 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584371 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:29:44.909258 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584374 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584377 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584379 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584382 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584385 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584387 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584390 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584393 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584395 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584398 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584414 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584417 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584420 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584449 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584458 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584461 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584465 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584469 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584473 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584476 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:29:44.909932 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584479 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584482 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584485 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584487 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584490 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584492 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584495 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584498 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584501 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584503 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584506 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584509 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584511 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584514 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584516 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584520 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584524 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584527 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584530 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:29:44.910546 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584533 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584536 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584538 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584541 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584544 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584547 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584550 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584560 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584564 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584567 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584569 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584572 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584575 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584578 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584580 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584585 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584589 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584592 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584595 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:29:44.911093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584598 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584602 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584605 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584608 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584610 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584613 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584616 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584619 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584621 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584624 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584627 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584629 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584632 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584635 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584637 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584640 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584642 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584645 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584648 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584650 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:29:44.911628 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584653 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584661 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.584664 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.585275 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.592864 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.592887 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.592914 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.592921 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.592991 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.592996 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593000 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593004 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593009 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593012 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593014 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:29:44.912207 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593017 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593020 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593023 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593026 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593028 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593031 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593034 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593037 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593039 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593042 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593045 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593047 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593050 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593053 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593056 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593058 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593061 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593063 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593066 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593069 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:29:44.912644 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593072 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593074 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593079 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593082 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593084 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593087 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593089 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593093 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593096 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593098 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593101 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593103 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593106 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593109 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593112 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593115 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593119 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593124 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593127 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:29:44.913197 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593130 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593134 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593138 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593141 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593143 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593146 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593149 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593152 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593155 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593158 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593160 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593163 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593166 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593168 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593171 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593175 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593178 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593180 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593183 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593185 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:29:44.913721 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593189 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593192 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593195 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593197 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593200 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593204 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593206 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593209 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593211 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593217 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593220 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593223 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593225 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593228 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593231 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593233 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593238 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593242 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593246 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593248 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:29:44.914329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593251 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593254 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593257 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593260 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593263 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593266 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593269 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593272 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593275 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593278 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593281 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593284 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593286 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.593291 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593458 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 16:29:44.914874 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593466 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593469 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593472 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593475 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593477 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593480 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593486 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593488 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593491 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593493 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593496 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593499 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593502 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593504 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593508 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593511 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593514 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593517 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593520 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593522 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 16:29:44.915328 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593525 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593527 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593530 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593533 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593535 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593538 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593540 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593543 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593546 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593549 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593551 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593555 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593559 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593562 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593564 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593567 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593569 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593572 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593577 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593579 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 16:29:44.915860 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593582 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593584 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593587 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593589 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593592 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593595 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593599 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593601 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593604 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593607 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593610 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593612 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593615 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593618 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593621 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593624 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593628 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593631 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593635 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 16:29:44.918744 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593638 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593642 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593645 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593648 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593651 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593653 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593656 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593659 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593661 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593664 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593667 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593671 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593673 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593676 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593678 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593681 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593683 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593686 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593689 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 16:29:44.919373 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593693 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593696 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593698 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593701 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593703 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593706 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593708 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593711 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593713 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593716 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593719 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593721 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593724 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593727 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593729 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593732 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593735 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593737 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593740 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 16:29:44.919994 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:44.593742 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.593747 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.593905 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.596191 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.597671 2576 server.go:1019] "Starting client certificate rotation" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.597786 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.597832 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.600571 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.602694 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.616918 2576 log.go:25] "Validated CRI v1 runtime API" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.619382 2576 log.go:25] "Validated CRI v1 image API" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.620336 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 16:29:44.920619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.624269 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8bf72d67-963d-4f6d-bb32-b5aaf3a9c7e9:/dev/nvme0n1p3 cbda9654-408c-4770-a984-1f246b0187d1:/dev/nvme0n1p4] Jul 14 16:29:44.921030 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.624288 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.631749 2576 manager.go:216] Machine: {Timestamp:2026-07-14 16:29:44.629452891 +0000 UTC m=+0.359826418 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100445 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a657f7a7c9a6fa1519477dafdfbd SystemUUID:ec28a657-f7a7-c9a6-fa15-19477dafdfbd BootID:89b1f38d-db3e-454f-9fa0-934f5a43aa34 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:be:a1:2b:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:be:a1:2b:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:39:7f:1c:76:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.631869 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.631983 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.635031 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.635064 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.635867 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.635878 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 16:29:44.921234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.635886 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.636532 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.637899 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.640981 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641133 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641162 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641173 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641189 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641198 2576 kubelet.go:398] "Adding apiserver pod source" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641207 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641523 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641657 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.641676 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.643933 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646674 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646703 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646893 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646912 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646923 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646938 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646954 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.646967 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.647311 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.647321 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.647330 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.647335 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.647344 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.647352 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.648745 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.648758 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.652471 2576 server.go:1268] "Started kubelet" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.652550 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.652754 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.653089 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.653173 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.653366 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.653537 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.654466 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.654959 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 14 16:29:44.921647 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.658707 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.659364 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.659377 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.659471 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.660337 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.660352 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.660429 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.660437 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.660448 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.660990 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661005 2576 factory.go:55] Registering systemd factory Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661014 2576 factory.go:223] Registration of the systemd container factory successfully Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661258 2576 factory.go:153] Registering CRI-O factory Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661276 2576 factory.go:223] Registration of the crio container factory successfully Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661299 2576 factory.go:103] Registering Raw factory Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661313 2576 manager.go:1196] Started watching for new ooms in manager Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.660087 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9cf5001a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.652431386 +0000 UTC m=+0.382804897,LastTimestamp:2026-07-14 16:29:44.652431386 +0000 UTC m=+0.382804897,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.661875 2576 manager.go:349] Starting recovery of all containers Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.664823 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.665973 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.675156 2576 manager.go:354] Recovery completed Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.680611 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.682643 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.682684 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.682700 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.683328 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.683336 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.683341 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.683361 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.684283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.684312 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.684326 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.684788 2576 policy_none.go:49] "None policy: Start" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.684802 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 16:29:44.922930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.684814 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.684896 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9ec25753 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.682665811 +0000 UTC m=+0.413039324,LastTimestamp:2026-07-14 16:29:44.682665811 +0000 UTC m=+0.413039324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.685889 2576 policy_none.go:47] "Start" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.702843 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9ec2b963 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.682690915 +0000 UTC m=+0.413064428,LastTimestamp:2026-07-14 16:29:44.682690915 +0000 UTC m=+0.413064428,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.722484 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9ec2f0fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-95.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.68270515 +0000 UTC m=+0.413078660,LastTimestamp:2026-07-14 16:29:44.68270515 +0000 UTC m=+0.413078660,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.723345 2576 manager.go:337] "Starting Device Plugin manager" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.723378 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.723449 2576 server.go:87] "Starting device plugin registration server" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.723773 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.723784 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.724222 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.724313 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.724321 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.725060 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 16:29:44.923863 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.725109 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.733388 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-95.ec2.internal.18c234ea9ec25753\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9ec25753 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.682665811 +0000 UTC m=+0.413039324,LastTimestamp:2026-07-14 16:29:44.684295856 +0000 UTC m=+0.414669366,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.746655 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-95.ec2.internal.18c234ea9ec2b963\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9ec2b963 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.682690915 +0000 UTC m=+0.413064428,LastTimestamp:2026-07-14 16:29:44.684319225 +0000 UTC m=+0.414692736,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.751561 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kf87" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.761660 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kf87" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.765951 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-95.ec2.internal.18c234ea9ec2f0fe\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-95.ec2.internal.18c234ea9ec2f0fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-95.ec2.internal,UID:ip-10-0-138-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-95.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-95.ec2.internal,},FirstTimestamp:2026-07-14 16:29:44.68270515 +0000 UTC m=+0.413078660,LastTimestamp:2026-07-14 16:29:44.684332066 +0000 UTC m=+0.414705576,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-95.ec2.internal,}" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.826071 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.827237 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.827272 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.827283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.827310 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.827996 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.829329 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.829365 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.829386 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.829430 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.831727 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:29:45.032847 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.842890 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.842927 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-95.ec2.internal\": node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.902862 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.929926 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal"] Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.930011 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.931907 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.931938 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.931951 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.933535 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.933719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.933758 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.934510 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.934539 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.934548 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.934512 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.934625 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.934639 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.935763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.935789 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.936656 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientMemory" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.936681 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.936691 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeHasSufficientPID" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.962258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed4b0f6053d8c96954c236175e72624a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-95.ec2.internal\" (UID: \"ed4b0f6053d8c96954c236175e72624a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.962291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72f9abc872708194e9aeb0bdffcb031b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal\" (UID: \"72f9abc872708194e9aeb0bdffcb031b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:44.962309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f9abc872708194e9aeb0bdffcb031b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal\" (UID: \"72f9abc872708194e9aeb0bdffcb031b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.970007 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-95.ec2.internal\" not found" node="ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:44.980558 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-95.ec2.internal\" not found" node="ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.033596 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.002953 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.062733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72f9abc872708194e9aeb0bdffcb031b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal\" (UID: \"72f9abc872708194e9aeb0bdffcb031b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.062775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f9abc872708194e9aeb0bdffcb031b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal\" (UID: \"72f9abc872708194e9aeb0bdffcb031b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.062806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed4b0f6053d8c96954c236175e72624a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-95.ec2.internal\" (UID: \"ed4b0f6053d8c96954c236175e72624a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.062848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72f9abc872708194e9aeb0bdffcb031b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal\" (UID: \"72f9abc872708194e9aeb0bdffcb031b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.062848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f9abc872708194e9aeb0bdffcb031b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal\" (UID: \"72f9abc872708194e9aeb0bdffcb031b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.062858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed4b0f6053d8c96954c236175e72624a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-95.ec2.internal\" (UID: \"ed4b0f6053d8c96954c236175e72624a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.142343 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.103922 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.250919 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.204459 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.331420 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.271907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.331420 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.283908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.331420 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.304969 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.473507 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.405616 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.613142 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.506073 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.613142 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.597519 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 16:29:45.613142 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.597680 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 16:29:45.613142 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:45.606745 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-95.ec2.internal\" not found" Jul 14 16:29:45.735088 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.703979 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.759775 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.764961 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 16:24:44 +0000 UTC" deadline="2028-01-07 18:25:27.687146154 +0000 UTC" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.764997 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13009h55m41.922152124s" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.776553 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.778267 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.789373 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:45.837462 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f9abc872708194e9aeb0bdffcb031b.slice/crio-fa65a820e69e9b247c79b41dcc04a2f078bc2e3d1d10f6795cd623228ace91f2 WatchSource:0}: Error finding container fa65a820e69e9b247c79b41dcc04a2f078bc2e3d1d10f6795cd623228ace91f2: Status 404 returned error can't find the container with id fa65a820e69e9b247c79b41dcc04a2f078bc2e3d1d10f6795cd623228ace91f2 Jul 14 16:29:45.844705 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:45.837949 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4b0f6053d8c96954c236175e72624a.slice/crio-983afb025d5e568fe131e05b03b40f1e7d54d78d95483869804e007124a98573 WatchSource:0}: Error finding container 983afb025d5e568fe131e05b03b40f1e7d54d78d95483869804e007124a98573: Status 404 returned error can't find the container with id 983afb025d5e568fe131e05b03b40f1e7d54d78d95483869804e007124a98573 Jul 14 16:29:45.849391 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:45.849280 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 16:29:46.305904 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.209376 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:29:46.305904 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.260150 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.645955 2576 apiserver.go:52] "Watching apiserver" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.653693 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.654950 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal","openshift-multus/multus-6wgm7","openshift-network-diagnostics/network-check-target-lczjs","kube-system/global-pull-secret-syncer-6b9q2","openshift-cluster-node-tuning-operator/tuned-9w2t6","openshift-image-registry/node-ca-j87mj","openshift-multus/multus-additional-cni-plugins-xvnvb","openshift-multus/network-metrics-daemon-wvhtb","openshift-network-operator/iptables-alerter-p7fhq","openshift-ovn-kubernetes/ovnkube-node-cn9dd","kube-system/konnectivity-agent-cdp5q","kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x","openshift-dns/node-resolver-7p78q"] Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.657460 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.659917 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.660671 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.660684 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.660902 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.660946 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.661071 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wgwn\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.661174 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.661273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.661798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.661865 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.665758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.665802 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wcrnz\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.666008 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.666856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.666914 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.668589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.668773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.668992 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n45bd\"" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.669152 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.670689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.686386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-cni-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-socket-dir-parent\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-cni-bin\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrxf\" (UniqueName: \"kubernetes.io/projected/55f4472b-e6f2-4880-9dd7-bd55534b53b4-kube-api-access-kwrxf\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-cnibin\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-system-cni-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-conf-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-os-release\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-os-release\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-k8s-cni-cncf-io\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-etc-kubernetes\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.687896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2xhl\" (UniqueName: \"kubernetes.io/projected/7a14939d-b812-4492-a577-06a8be969715-kube-api-access-x2xhl\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-cni-multus\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-kubelet\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-system-cni-dir\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55f4472b-e6f2-4880-9dd7-bd55534b53b4-cni-binary-copy\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-hostroot\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671622 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-cnibin\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-netns\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-daemon-config\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-multus-certs\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.671980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rmmcc\"" Jul 14 16:29:46.689199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.672023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.711937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.711884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:46.712303 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.712276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 16:29:46.714754 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.712809 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:46.714754 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.713212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.714754 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.714097 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 16:29:46.714754 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.714362 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4lxww\"" Jul 14 16:29:46.714754 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.714306 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.715809 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.715761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.718567 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.718539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.721190 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.721161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.723509 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.723480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.729019 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.728994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.730061 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730039 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 16:29:46.730472 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730454 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 16:29:46.730573 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730534 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-46cw6" Jul 14 16:29:46.730638 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730620 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 16:29:46.730683 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730670 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.730725 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730671 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.730950 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730935 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.731006 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.731094 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731067 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.731302 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tdmvv\"" Jul 14 16:29:46.731394 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rdcv\"" Jul 14 16:29:46.731394 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731389 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pp95f\"" Jul 14 16:29:46.731558 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.730990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 16:29:46.731633 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731616 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 16:29:46.731688 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731658 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l6hxc\"" Jul 14 16:29:46.731688 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731672 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 16:29:46.731688 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.731682 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 16:29:46.732445 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.732389 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 16:29:46.733243 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.733226 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 16:29:46.739052 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.739023 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-46cw6" Jul 14 16:29:46.762360 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.762158 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 16:29:46.772450 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.772450 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-device-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-cni-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-socket-dir-parent\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovnkube-script-lib\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5sjj\" (UniqueName: \"kubernetes.io/projected/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-kube-api-access-n5sjj\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.772672 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsljd\" (UniqueName: \"kubernetes.io/projected/c5149745-96d8-4185-aec6-3f0441bfe5a2-kube-api-access-qsljd\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-tuned\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-kubelet\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-cni-netd\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-socket-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-host\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-cnibin\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysctl-d\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-sys\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.772973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-os-release\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.772980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovn-node-metrics-cert\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-kubelet-config\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-serviceca\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-k8s-cni-cncf-io\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-etc-kubernetes\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-modprobe-d\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysctl-conf\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-var-lib-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-node-log\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2xhl\" (UniqueName: \"kubernetes.io/projected/7a14939d-b812-4492-a577-06a8be969715-kube-api-access-x2xhl\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-systemd-units\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.773356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-etc-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-etc-kubernetes\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-cni-bin\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-os-release\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-socket-dir-parent\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-cni-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773710 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-k8s-cni-cncf-io\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-registration-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-cnibin\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-etc-selinux\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55f4472b-e6f2-4880-9dd7-bd55534b53b4-cni-binary-copy\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61791eef-aa5f-492a-8912-3dbfe7484202-iptables-alerter-script\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-systemd\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-sys-fs\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.774054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-netns\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-daemon-config\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.773983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-multus-certs\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-run\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-lib-modules\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-slash\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774140 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-netns\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-run-netns\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-systemd\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-tmp\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-env-overrides\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774285 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-run-multus-certs\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.774728 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhm2\" (UniqueName: \"kubernetes.io/projected/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-kube-api-access-5bhm2\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-cni-bin\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55f4472b-e6f2-4880-9dd7-bd55534b53b4-cni-binary-copy\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrxf\" (UniqueName: \"kubernetes.io/projected/55f4472b-e6f2-4880-9dd7-bd55534b53b4-kube-api-access-kwrxf\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02167480-d684-4628-a070-ed8fd8f5f1a7-agent-certs\") pod \"konnectivity-agent-cdp5q\" (UID: \"02167480-d684-4628-a070-ed8fd8f5f1a7\") " pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5flr\" (UniqueName: \"kubernetes.io/projected/94904021-9316-452f-b70c-ec042281f616-kube-api-access-q5flr\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774600 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-daemon-config\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-cni-bin\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a812f567-b022-43f6-8a27-48285783308f-hosts-file\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a812f567-b022-43f6-8a27-48285783308f-tmp-dir\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-dbus\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.774988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-system-cni-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.775367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-conf-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6hkn\" (UniqueName: \"kubernetes.io/projected/a812f567-b022-43f6-8a27-48285783308f-kube-api-access-f6hkn\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-os-release\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02167480-d684-4628-a070-ed8fd8f5f1a7-konnectivity-ca\") pod \"konnectivity-agent-cdp5q\" (UID: \"02167480-d684-4628-a070-ed8fd8f5f1a7\") " pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775106 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-system-cni-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775116 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-multus-conf-dir\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-log-socket\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-os-release\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-kubernetes\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-ovn\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-cni-multus\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-kubelet\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-cni-multus\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4t5s\" (UniqueName: \"kubernetes.io/projected/61791eef-aa5f-492a-8912-3dbfe7484202-kube-api-access-k4t5s\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-host-var-lib-kubelet\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-var-lib-kubelet\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz64k\" (UniqueName: \"kubernetes.io/projected/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-kube-api-access-vz64k\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-system-cni-dir\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-hostroot\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61791eef-aa5f-492a-8912-3dbfe7484202-host-slash\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovnkube-config\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-cnibin\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysconfig\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-host\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.775825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a14939d-b812-4492-a577-06a8be969715-system-cni-dir\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.776765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.776295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a14939d-b812-4492-a577-06a8be969715-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.777391 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.776353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-hostroot\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.777391 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.776446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55f4472b-e6f2-4880-9dd7-bd55534b53b4-cnibin\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.792998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.792962 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 16:29:46.795325 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.795016 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:29:46.795325 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.795049 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:29:46.795325 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.795063 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:46.795325 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.795134 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:47.2951116 +0000 UTC m=+3.025485116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:46.797599 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.797571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrxf\" (UniqueName: \"kubernetes.io/projected/55f4472b-e6f2-4880-9dd7-bd55534b53b4-kube-api-access-kwrxf\") pod \"multus-6wgm7\" (UID: \"55f4472b-e6f2-4880-9dd7-bd55534b53b4\") " pod="openshift-multus/multus-6wgm7" Jul 14 16:29:46.797752 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.797602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2xhl\" (UniqueName: \"kubernetes.io/projected/7a14939d-b812-4492-a577-06a8be969715-kube-api-access-x2xhl\") pod \"multus-additional-cni-plugins-xvnvb\" (UID: \"7a14939d-b812-4492-a577-06a8be969715\") " pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:46.834885 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.834827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" event={"ID":"72f9abc872708194e9aeb0bdffcb031b","Type":"ContainerStarted","Data":"fa65a820e69e9b247c79b41dcc04a2f078bc2e3d1d10f6795cd623228ace91f2"} Jul 14 16:29:46.836254 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.836222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" event={"ID":"ed4b0f6053d8c96954c236175e72624a","Type":"ContainerStarted","Data":"983afb025d5e568fe131e05b03b40f1e7d54d78d95483869804e007124a98573"} Jul 14 16:29:46.876471 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-run\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.876471 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-lib-modules\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-run\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-slash\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-slash\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-run-netns\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-systemd\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-lib-modules\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-tmp\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-env-overrides\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876594 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-run-netns\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-systemd\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhm2\" (UniqueName: \"kubernetes.io/projected/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-kube-api-access-5bhm2\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02167480-d684-4628-a070-ed8fd8f5f1a7-agent-certs\") pod \"konnectivity-agent-cdp5q\" (UID: \"02167480-d684-4628-a070-ed8fd8f5f1a7\") " pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5flr\" (UniqueName: \"kubernetes.io/projected/94904021-9316-452f-b70c-ec042281f616-kube-api-access-q5flr\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a812f567-b022-43f6-8a27-48285783308f-hosts-file\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.877099 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a812f567-b022-43f6-8a27-48285783308f-tmp-dir\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-dbus\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6hkn\" (UniqueName: \"kubernetes.io/projected/a812f567-b022-43f6-8a27-48285783308f-kube-api-access-f6hkn\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-dbus\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02167480-d684-4628-a070-ed8fd8f5f1a7-konnectivity-ca\") pod \"konnectivity-agent-cdp5q\" (UID: \"02167480-d684-4628-a070-ed8fd8f5f1a7\") " pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876833 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a812f567-b022-43f6-8a27-48285783308f-hosts-file\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-log-socket\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-log-socket\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.876963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-kubernetes\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-ovn\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4t5s\" (UniqueName: \"kubernetes.io/projected/61791eef-aa5f-492a-8912-3dbfe7484202-kube-api-access-k4t5s\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-var-lib-kubelet\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz64k\" (UniqueName: \"kubernetes.io/projected/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-kube-api-access-vz64k\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61791eef-aa5f-492a-8912-3dbfe7484202-host-slash\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.877918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877144 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a812f567-b022-43f6-8a27-48285783308f-tmp-dir\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovnkube-config\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-env-overrides\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysconfig\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-host\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877231 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-var-lib-kubelet\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-ovn\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877285 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-kubernetes\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877303 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61791eef-aa5f-492a-8912-3dbfe7484202-host-slash\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysconfig\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877339 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-host\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-kubelet-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.878627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-device-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovnkube-script-lib\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02167480-d684-4628-a070-ed8fd8f5f1a7-konnectivity-ca\") pod \"konnectivity-agent-cdp5q\" (UID: \"02167480-d684-4628-a070-ed8fd8f5f1a7\") " pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sjj\" (UniqueName: \"kubernetes.io/projected/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-kube-api-access-n5sjj\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-run-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsljd\" (UniqueName: \"kubernetes.io/projected/c5149745-96d8-4185-aec6-3f0441bfe5a2-kube-api-access-qsljd\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-tuned\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.877561 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-kubelet\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-device-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-cni-netd\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.877638 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:29:47.377619682 +0000 UTC m=+3.107993204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:46.879313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-socket-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-host\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysctl-d\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-sys\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovnkube-config\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovn-node-metrics-cert\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-kubelet-config\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-socket-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-serviceca\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.877978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-modprobe-d\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysctl-d\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysctl-conf\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-var-lib-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878058 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-host\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.879998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovnkube-script-lib\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-node-log\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-var-lib-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878150 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-cni-netd\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-systemd-units\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-kubelet\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-systemd-units\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-etc-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-cni-bin\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-etc-openvswitch\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-registration-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878252 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-sysctl-conf\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878275 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-sys\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.880598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-etc-selinux\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61791eef-aa5f-492a-8912-3dbfe7484202-iptables-alerter-script\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.878340 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-etc-selinux\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:46.878426 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:47.378392335 +0000 UTC m=+3.108765848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878436 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-host-cni-bin\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878383 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-systemd\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-serviceca\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878474 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-kubelet-config\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-sys-fs\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-systemd\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-registration-dir\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94904021-9316-452f-b70c-ec042281f616-sys-fs\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878630 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-node-log\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.881109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878641 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-modprobe-d\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.881595 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.878985 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61791eef-aa5f-492a-8912-3dbfe7484202-iptables-alerter-script\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.881595 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.879575 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-tmp\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.881595 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.879731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02167480-d684-4628-a070-ed8fd8f5f1a7-agent-certs\") pod \"konnectivity-agent-cdp5q\" (UID: \"02167480-d684-4628-a070-ed8fd8f5f1a7\") " pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:46.881595 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.880735 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-etc-tuned\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.881595 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.880750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-ovn-node-metrics-cert\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.889570 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.889535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhm2\" (UniqueName: \"kubernetes.io/projected/6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53-kube-api-access-5bhm2\") pod \"node-ca-j87mj\" (UID: \"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53\") " pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:46.890260 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.889987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz64k\" (UniqueName: \"kubernetes.io/projected/09d0c4b0-3b16-45d7-83c1-f598ceca9ab6-kube-api-access-vz64k\") pod \"tuned-9w2t6\" (UID: \"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6\") " pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:46.890260 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.890192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4t5s\" (UniqueName: \"kubernetes.io/projected/61791eef-aa5f-492a-8912-3dbfe7484202-kube-api-access-k4t5s\") pod \"iptables-alerter-p7fhq\" (UID: \"61791eef-aa5f-492a-8912-3dbfe7484202\") " pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:46.890477 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.890454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5sjj\" (UniqueName: \"kubernetes.io/projected/e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0-kube-api-access-n5sjj\") pod \"ovnkube-node-cn9dd\" (UID: \"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:46.891463 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.891393 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5flr\" (UniqueName: \"kubernetes.io/projected/94904021-9316-452f-b70c-ec042281f616-kube-api-access-q5flr\") pod \"aws-ebs-csi-driver-node-64t9x\" (UID: \"94904021-9316-452f-b70c-ec042281f616\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:46.891579 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.891556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsljd\" (UniqueName: \"kubernetes.io/projected/c5149745-96d8-4185-aec6-3f0441bfe5a2-kube-api-access-qsljd\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:46.892865 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.892838 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6hkn\" (UniqueName: \"kubernetes.io/projected/a812f567-b022-43f6-8a27-48285783308f-kube-api-access-f6hkn\") pod \"node-resolver-7p78q\" (UID: \"a812f567-b022-43f6-8a27-48285783308f\") " pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:46.971710 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:46.971667 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" Jul 14 16:29:47.020086 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.020053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wgm7" Jul 14 16:29:47.032972 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.032928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:29:47.039918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.039876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j87mj" Jul 14 16:29:47.048043 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.048009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" Jul 14 16:29:47.059037 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.059004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p7fhq" Jul 14 16:29:47.066227 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.066194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:29:47.075259 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.075215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" Jul 14 16:29:47.082417 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.082371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7p78q" Jul 14 16:29:47.381262 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.381222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:47.381262 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.381271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.381313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381436 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381448 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381460 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381472 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381451 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:47.381521 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381505 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:48.381486041 +0000 UTC m=+4.111859555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:47.381763 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:48.381532867 +0000 UTC m=+4.111906368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:47.381763 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:47.381568 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:29:48.381558184 +0000 UTC m=+4.111931682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:47.618738 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:47.618709 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61791eef_aa5f_492a_8912_3dbfe7484202.slice/crio-d1c8af5f241f6b3f4b96d63d82012fa31d3c5be688176a7c59f0fa8caf180660 WatchSource:0}: Error finding container d1c8af5f241f6b3f4b96d63d82012fa31d3c5be688176a7c59f0fa8caf180660: Status 404 returned error can't find the container with id d1c8af5f241f6b3f4b96d63d82012fa31d3c5be688176a7c59f0fa8caf180660 Jul 14 16:29:47.619999 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:47.619971 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda812f567_b022_43f6_8a27_48285783308f.slice/crio-bb67129b5367837a00ee145e0aec1a3f5b69badaf732923517b11c4f19140e9d WatchSource:0}: Error finding container bb67129b5367837a00ee145e0aec1a3f5b69badaf732923517b11c4f19140e9d: Status 404 returned error can't find the container with id bb67129b5367837a00ee145e0aec1a3f5b69badaf732923517b11c4f19140e9d Jul 14 16:29:47.643938 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:47.643911 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b37dcd_b10a_4b42_9ba1_b5ed6fd5f7c0.slice/crio-7c631b08a94ca3e4191609c611e4fe864e40a008e7ce6811a6d70e2f2dd699bc WatchSource:0}: Error finding container 7c631b08a94ca3e4191609c611e4fe864e40a008e7ce6811a6d70e2f2dd699bc: Status 404 returned error can't find the container with id 7c631b08a94ca3e4191609c611e4fe864e40a008e7ce6811a6d70e2f2dd699bc Jul 14 16:29:47.645140 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:29:47.645111 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94904021_9316_452f_b70c_ec042281f616.slice/crio-5fc2974558247c3fa73cd68248fdf1823fe0281e7087faae9027577c8e7b9ce9 WatchSource:0}: Error finding container 5fc2974558247c3fa73cd68248fdf1823fe0281e7087faae9027577c8e7b9ce9: Status 404 returned error can't find the container with id 5fc2974558247c3fa73cd68248fdf1823fe0281e7087faae9027577c8e7b9ce9 Jul 14 16:29:47.742639 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.742570 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:24:46 +0000 UTC" deadline="2028-04-10 07:30:29.394130416 +0000 UTC" Jul 14 16:29:47.742639 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.742632 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15255h0m41.651501553s" Jul 14 16:29:47.840320 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.840280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" event={"ID":"ed4b0f6053d8c96954c236175e72624a","Type":"ContainerStarted","Data":"ff1dc1181fc292530f290916c49cbc82cf73058a1ceff8d360a9bf73a6c8a511"} Jul 14 16:29:47.841512 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.841483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j87mj" event={"ID":"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53","Type":"ContainerStarted","Data":"b67185b42917b39a085f29b74460f04282abeeaafe8fac057d180ff83dab2216"} Jul 14 16:29:47.842727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.842697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerStarted","Data":"7e2f28fda83ea6f6f658457d2d906c8211f39783719a03d453427a7c206fa9d9"} Jul 14 16:29:47.843903 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.843875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" event={"ID":"94904021-9316-452f-b70c-ec042281f616","Type":"ContainerStarted","Data":"5fc2974558247c3fa73cd68248fdf1823fe0281e7087faae9027577c8e7b9ce9"} Jul 14 16:29:47.845139 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.845113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7p78q" event={"ID":"a812f567-b022-43f6-8a27-48285783308f","Type":"ContainerStarted","Data":"bb67129b5367837a00ee145e0aec1a3f5b69badaf732923517b11c4f19140e9d"} Jul 14 16:29:47.846486 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.846463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" event={"ID":"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6","Type":"ContainerStarted","Data":"0d9f780edd557ee670ef29e475b45d08c85d0a6241041d17c6119b12b6f915b5"} Jul 14 16:29:47.847722 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.847684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdp5q" event={"ID":"02167480-d684-4628-a070-ed8fd8f5f1a7","Type":"ContainerStarted","Data":"d9a13e36d01a0d1f5afe085daabce38c384170ecb4b44d2843bb68a719ce1ece"} Jul 14 16:29:47.849014 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.848989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"7c631b08a94ca3e4191609c611e4fe864e40a008e7ce6811a6d70e2f2dd699bc"} Jul 14 16:29:47.850184 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.850154 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p7fhq" event={"ID":"61791eef-aa5f-492a-8912-3dbfe7484202","Type":"ContainerStarted","Data":"d1c8af5f241f6b3f4b96d63d82012fa31d3c5be688176a7c59f0fa8caf180660"} Jul 14 16:29:47.851341 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.851315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wgm7" event={"ID":"55f4472b-e6f2-4880-9dd7-bd55534b53b4","Type":"ContainerStarted","Data":"662f9d2f28ef09bb49de86797e5354912b11b50bc931f5d37e18fad57ba6d116"} Jul 14 16:29:47.860273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:47.860208 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-95.ec2.internal" podStartSLOduration=2.860192913 podStartE2EDuration="2.860192913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:29:47.859570519 +0000 UTC m=+3.589944038" watchObservedRunningTime="2026-07-14 16:29:47.860192913 +0000 UTC m=+3.590566431" Jul 14 16:29:48.388248 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.388201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:48.388915 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.388282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:48.388915 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.388331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:48.388915 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.388520 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:48.388915 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.388589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:50.388568816 +0000 UTC m=+6.118942314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:48.389146 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.389004 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:29:48.389146 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.389023 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:29:48.389146 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.389036 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:48.389146 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.389081 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:50.389066281 +0000 UTC m=+6.119439791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:48.389146 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.389140 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:48.389381 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.389174 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:29:50.389162953 +0000 UTC m=+6.119536452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:48.743759 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.743653 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:24:46 +0000 UTC" deadline="2028-01-25 10:55:36.448486941 +0000 UTC" Jul 14 16:29:48.743759 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.743703 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h25m47.704788917s" Jul 14 16:29:48.830885 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.830528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:48.831062 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.831009 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:48.831485 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.831456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:48.831590 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.831568 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:48.831647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:48.831635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:48.831719 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:48.831703 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:29:49.865550 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:49.865510 2576 generic.go:356] "Generic (PLEG): container finished" podID="72f9abc872708194e9aeb0bdffcb031b" containerID="4fe8ee3b1c2fa9f220a6d15fc7d043a02a712655157f6e032eb16f577d87373e" exitCode=0 Jul 14 16:29:49.866014 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:49.865569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" event={"ID":"72f9abc872708194e9aeb0bdffcb031b","Type":"ContainerDied","Data":"4fe8ee3b1c2fa9f220a6d15fc7d043a02a712655157f6e032eb16f577d87373e"} Jul 14 16:29:50.406749 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:50.406706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:50.406874 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:50.406757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:50.406874 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:50.406805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:50.406990 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.406892 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:50.406990 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.406910 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:50.406990 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.406965 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:29:54.40694553 +0000 UTC m=+10.137319041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:50.406990 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.406894 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:29:50.406990 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.406986 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:54.406975181 +0000 UTC m=+10.137348678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:50.407329 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.406993 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:29:50.407329 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.407007 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:50.407329 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.407055 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:29:54.407044245 +0000 UTC m=+10.137417742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:50.830637 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:50.830545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:50.830637 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:50.830574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:50.830857 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.830682 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:50.830857 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:50.830788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:50.830948 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.830877 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:29:50.830998 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:50.830969 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:52.831020 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:52.830493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:52.831020 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:52.830502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:52.831020 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:52.830633 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:29:52.831020 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:52.830714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:52.831020 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:52.830502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:52.831020 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:52.830819 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:54.442306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:54.442381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:54.442462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442641 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442674 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442692 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442705 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442712 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:30:02.442692226 +0000 UTC m=+18.173065736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:29:54.442764 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442739 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:02.442729263 +0000 UTC m=+18.173102773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:29:54.443675 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442800 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:54.443675 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.442877 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:02.442857061 +0000 UTC m=+18.173230556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:29:54.831133 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:54.830936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:54.831133 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.831063 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:29:54.831133 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:54.831106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:54.831428 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.831243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:54.831428 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:54.831302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:54.831428 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:54.831366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:56.830654 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:56.830618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:56.831101 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:56.830618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:56.831101 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:56.830766 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:56.831101 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:56.830618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:56.831101 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:56.830836 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:56.831101 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:56.830876 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:29:58.830098 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:58.830055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:29:58.830592 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:58.830055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:29:58.830592 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:29:58.830072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:29:58.830592 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:58.830242 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:29:58.830592 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:58.830297 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:29:58.830592 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:29:58.830360 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:00.830071 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:00.830029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:00.830510 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:00.830167 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:00.830510 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:00.830034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:00.830510 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:00.830243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:00.830510 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:00.830034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:00.830510 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:00.830299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:02.507042 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:02.507002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:02.507051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:02.507092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507194 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507208 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507205 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507266 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507271 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:30:18.507249678 +0000 UTC m=+34.237623177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507280 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507294 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:18.507282491 +0000 UTC m=+34.237656000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:02.507575 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.507323 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:18.507307561 +0000 UTC m=+34.237681081 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:02.830050 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:02.829949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:02.830216 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:02.829960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:02.830216 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.830097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:02.830216 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:02.829967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:02.830216 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.830194 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:02.830418 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:02.830267 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:04.831226 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:04.831184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:04.831737 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:04.831299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:04.831737 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:04.831342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:04.831737 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:04.831352 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:04.831737 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:04.831436 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:04.831737 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:04.831519 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:06.829839 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.829810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:06.830490 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.829814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:06.830490 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:06.829931 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:06.830490 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.829813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:06.830490 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:06.830009 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:06.830490 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:06.830069 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:06.904151 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.904082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" event={"ID":"72f9abc872708194e9aeb0bdffcb031b","Type":"ContainerStarted","Data":"941d8b8912ac34989bd560a65914f117c3231d0ab1841ecf5f3617f2e1f93e4a"} Jul 14 16:30:06.906107 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.906026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j87mj" event={"ID":"6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53","Type":"ContainerStarted","Data":"e248b632eff21ce1d6a74a3c1c7be7f2778be3096cc14c6ee7c1cc13ac0d2d02"} Jul 14 16:30:06.907984 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.907946 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a14939d-b812-4492-a577-06a8be969715" containerID="65f7387a0617c9c426ff6d7120c2ae8a78875e696152bb397431267bd364a096" exitCode=0 Jul 14 16:30:06.908175 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.908023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerDied","Data":"65f7387a0617c9c426ff6d7120c2ae8a78875e696152bb397431267bd364a096"} Jul 14 16:30:06.910332 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.910307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" event={"ID":"94904021-9316-452f-b70c-ec042281f616","Type":"ContainerStarted","Data":"b2d94bf950086953b87e620698d9a17ac7557ca68582d773d9b9f8a706b166d5"} Jul 14 16:30:06.911909 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.911871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7p78q" event={"ID":"a812f567-b022-43f6-8a27-48285783308f","Type":"ContainerStarted","Data":"ca8908f225318c6abc0559e42e5eed45e1fbffa3631f785d8b085e6ec2a68929"} Jul 14 16:30:06.913590 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.913560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" event={"ID":"09d0c4b0-3b16-45d7-83c1-f598ceca9ab6","Type":"ContainerStarted","Data":"e5b3c8d2662da503ef187be2f8cc70eb5e859a71b8569f6d81c8b8c2c648f60a"} Jul 14 16:30:06.915256 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.915222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdp5q" event={"ID":"02167480-d684-4628-a070-ed8fd8f5f1a7","Type":"ContainerStarted","Data":"a12dc0d99a10c4fdacca67a012b2c48beb38322aeb36cf8417c0c7f1037ec918"} Jul 14 16:30:06.917243 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.917215 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:30:06.917631 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.917605 2576 generic.go:356] "Generic (PLEG): container finished" podID="e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0" containerID="e5dadad173e7d008da1aeba405edf681ecedd389a204ea6f39fb2859fe661a08" exitCode=1 Jul 14 16:30:06.917714 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.917675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerDied","Data":"e5dadad173e7d008da1aeba405edf681ecedd389a204ea6f39fb2859fe661a08"} Jul 14 16:30:06.917786 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.917768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"6f8a7445dc223ade41af8c688fa784a34a5cc559fcbc97d7f43f160222793c16"} Jul 14 16:30:06.919304 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.919277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wgm7" event={"ID":"55f4472b-e6f2-4880-9dd7-bd55534b53b4","Type":"ContainerStarted","Data":"7964f155b5949e8a71868c491795d7fbc3a42d848d57f467e70e27f96071b424"} Jul 14 16:30:06.930778 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.930717 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-95.ec2.internal" podStartSLOduration=21.930691707 podStartE2EDuration="21.930691707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:06.930511301 +0000 UTC m=+22.660884819" watchObservedRunningTime="2026-07-14 16:30:06.930691707 +0000 UTC m=+22.661065226" Jul 14 16:30:06.951793 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.951739 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cdp5q" podStartSLOduration=8.636202288 podStartE2EDuration="22.951717445s" totalImagesPullingTime="14.315515157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:06.951550296 +0000 UTC m=+22.681923814" watchObservedRunningTime="2026-07-14 16:30:06.951717445 +0000 UTC m=+22.682090967" Jul 14 16:30:06.974556 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.974495 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9w2t6" podStartSLOduration=3.106975967 podStartE2EDuration="21.974479231s" totalImagesPullingTime="18.867503264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:06.97429867 +0000 UTC m=+22.704672188" watchObservedRunningTime="2026-07-14 16:30:06.974479231 +0000 UTC m=+22.704852748" Jul 14 16:30:06.995299 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:06.995248 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6wgm7" podStartSLOduration=4.0268746 podStartE2EDuration="22.995234422s" totalImagesPullingTime="18.968359822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:06.994995665 +0000 UTC m=+22.725369182" watchObservedRunningTime="2026-07-14 16:30:06.995234422 +0000 UTC m=+22.725607940" Jul 14 16:30:07.027738 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.027682 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j87mj" podStartSLOduration=3.16975944 podStartE2EDuration="22.02766396s" totalImagesPullingTime="18.85790452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:07.02670754 +0000 UTC m=+22.757081070" watchObservedRunningTime="2026-07-14 16:30:07.02766396 +0000 UTC m=+22.758037478" Jul 14 16:30:07.048613 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.048558 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7p78q" podStartSLOduration=3.166537512 podStartE2EDuration="22.048540237s" totalImagesPullingTime="18.882002725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:07.048481302 +0000 UTC m=+22.778854817" watchObservedRunningTime="2026-07-14 16:30:07.048540237 +0000 UTC m=+22.778913755" Jul 14 16:30:07.925824 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.925477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:30:07.926833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.926078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"075090069b058f603a036f53ff2e23513a6f6a72eabe2ecfa24c4c4353173b30"} Jul 14 16:30:07.926833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.926213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"b8b07327fb44402f308418e9da466f18ac5e20bdec7bd943d28eb41c5e94af06"} Jul 14 16:30:07.926833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.926264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"afb15159ee4a0c0876ec54a5cb91e52e8e6c6415a212b663ac961722fc1248d2"} Jul 14 16:30:07.926833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:07.926309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"d6df485ff02dd76d393bd3bce3f76f8c4abeb5baebe84a45649a7552f1c4d049"} Jul 14 16:30:08.829729 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.829697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:08.829884 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:08.829806 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:08.830196 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.830170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:08.830354 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.830170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:08.830354 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:08.830282 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:08.830563 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:08.830393 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:08.889523 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.889492 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 16:30:08.931224 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.931173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" event={"ID":"94904021-9316-452f-b70c-ec042281f616","Type":"ContainerStarted","Data":"bcaec80e65aba9735c3c2a5c7728e18be97564dd17c8e35ae4797b3dd1b1f821"} Jul 14 16:30:08.932953 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.932918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p7fhq" event={"ID":"61791eef-aa5f-492a-8912-3dbfe7484202","Type":"ContainerStarted","Data":"de56d1bb9f50d527feb167c3d40e3dc4c686aace8048cbaecb092b12c8ddfe02"} Jul 14 16:30:08.952012 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:08.951948 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p7fhq" podStartSLOduration=5.076641431 podStartE2EDuration="23.951928518s" totalImagesPullingTime="18.875287087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:08.95137881 +0000 UTC m=+24.681752329" watchObservedRunningTime="2026-07-14 16:30:08.951928518 +0000 UTC m=+24.682302037" Jul 14 16:30:09.738862 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:09.738676 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T16:30:08.889516113Z","UUID":"855a67e5-baa7-4fa8-bec1-e68cee182718","Handler":null,"Name":"","Endpoint":""} Jul 14 16:30:09.740573 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:09.740542 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 16:30:09.740734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:09.740609 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 16:30:09.939253 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:09.939226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:30:09.939792 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:09.939765 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"d1bf11a23700a831239a43eeea9d0bbd7d4c17652f2fbc830154a1bd847d8a77"} Jul 14 16:30:10.830147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:10.829893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:10.830395 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:10.829906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:10.830395 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:10.830267 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:10.830395 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:10.829939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:10.830395 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:10.830344 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:10.830662 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:10.830398 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:11.078229 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.078181 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:30:11.078825 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.078809 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:30:11.946339 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.946305 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a14939d-b812-4492-a577-06a8be969715" containerID="535c4cea9552abfc8921d1eb6d6a61ecbb39b299ce5fe7b1fdc0d103aaf6e807" exitCode=0 Jul 14 16:30:11.946520 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.946391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerDied","Data":"535c4cea9552abfc8921d1eb6d6a61ecbb39b299ce5fe7b1fdc0d103aaf6e807"} Jul 14 16:30:11.948959 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.948670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" event={"ID":"94904021-9316-452f-b70c-ec042281f616","Type":"ContainerStarted","Data":"d3df7e33583728152d426a8d3f248b53e1f06821f5f76cc280670a2254567383"} Jul 14 16:30:11.952438 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.952415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:30:11.952876 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.952849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"7e7b5d81d8ada1e7b73f79fac6a11a27e24357e9bef9660d4648df5e4b46a6df"} Jul 14 16:30:11.953273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.953168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:30:11.953273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.953208 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:30:11.953430 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.953378 2576 scope.go:117] "RemoveContainer" containerID="e5dadad173e7d008da1aeba405edf681ecedd389a204ea6f39fb2859fe661a08" Jul 14 16:30:11.955392 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:11.955207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cdp5q" Jul 14 16:30:12.084070 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.084017 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-64t9x" podStartSLOduration=3.524775509 podStartE2EDuration="27.083999777s" totalImagesPullingTime="23.559224268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:12.083830585 +0000 UTC m=+27.814204105" watchObservedRunningTime="2026-07-14 16:30:12.083999777 +0000 UTC m=+27.814373286" Jul 14 16:30:12.829809 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.829774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:12.830005 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.829774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:12.830005 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:12.829908 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:12.830005 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.829774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:12.830005 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:12.829979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:12.830204 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:12.830077 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:12.960169 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.960070 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:30:12.960591 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.960563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" event={"ID":"e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0","Type":"ContainerStarted","Data":"a150b69257ce0d70df62c1edf94d07da1d15fd982e8e4762ccec09eb1f22ae3a"} Jul 14 16:30:12.961304 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.961254 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:30:12.961429 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.961330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:30:12.980112 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.980075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:30:12.981541 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:12.981510 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:30:13.059554 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:13.059499 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" podStartSLOduration=9.123412459 podStartE2EDuration="28.059481057s" totalImagesPullingTime="18.936068598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:13.00838805 +0000 UTC m=+28.738761570" watchObservedRunningTime="2026-07-14 16:30:13.059481057 +0000 UTC m=+28.789854574" Jul 14 16:30:13.964731 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:13.964692 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a14939d-b812-4492-a577-06a8be969715" containerID="bb2559399e3b7e85514b6ec7cea3f2cee76177507a72ebfb02eb886cbdd4f8f7" exitCode=0 Jul 14 16:30:13.965239 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:13.964798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerDied","Data":"bb2559399e3b7e85514b6ec7cea3f2cee76177507a72ebfb02eb886cbdd4f8f7"} Jul 14 16:30:14.136000 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:14.135966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6b9q2"] Jul 14 16:30:14.136167 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:14.136085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:14.136213 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:14.136187 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:14.138827 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:14.138793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wvhtb"] Jul 14 16:30:14.139002 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:14.138924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:14.139066 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:14.139027 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:14.139445 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:14.139398 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lczjs"] Jul 14 16:30:14.139551 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:14.139531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:14.139645 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:14.139626 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:15.830372 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:15.830331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:15.830372 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:15.830358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:15.830860 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:15.830330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:15.830860 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:15.830465 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:15.830860 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:15.830581 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:15.831211 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:15.831024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:15.972778 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:15.972397 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a14939d-b812-4492-a577-06a8be969715" containerID="db8c89e3ff937e7d035791cc6fc3ecabb819a1723526929b03a91d9cea69416b" exitCode=0 Jul 14 16:30:15.972778 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:15.972506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerDied","Data":"db8c89e3ff937e7d035791cc6fc3ecabb819a1723526929b03a91d9cea69416b"} Jul 14 16:30:17.830028 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:17.829988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:17.830681 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:17.830032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:17.830681 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:17.830130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:17.830681 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:17.830129 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:17.830681 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:17.830262 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:17.830681 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:17.830354 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:18.534288 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:18.534251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:18.534502 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:18.534320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:18.534502 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:18.534351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:18.534502 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534430 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:18.534502 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534452 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:18.534639 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534508 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:50.534488028 +0000 UTC m=+66.264861547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 16:30:18.534639 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534524 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret podName:812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c nodeName:}" failed. No retries permitted until 2026-07-14 16:30:50.534517981 +0000 UTC m=+66.264891476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret") pod "global-pull-secret-syncer-6b9q2" (UID: "812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c") : object "kube-system"/"original-pull-secret" not registered Jul 14 16:30:18.534639 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534539 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 16:30:18.534639 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534569 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 16:30:18.534639 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534582 2576 projected.go:196] Error preparing data for projected volume kube-api-access-rb4ml for pod openshift-network-diagnostics/network-check-target-lczjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:18.534639 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:18.534634 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml podName:80bc4ef1-8cec-4e23-8136-3ab97fbae723 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:50.534622607 +0000 UTC m=+66.264996107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rb4ml" (UniqueName: "kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml") pod "network-check-target-lczjs" (UID: "80bc4ef1-8cec-4e23-8136-3ab97fbae723") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 16:30:19.829849 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:19.829802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:19.830496 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:19.829802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:19.830496 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:19.829945 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b9q2" podUID="812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c" Jul 14 16:30:19.830496 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:19.830021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lczjs" podUID="80bc4ef1-8cec-4e23-8136-3ab97fbae723" Jul 14 16:30:19.830496 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:19.829802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:19.830496 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:19.830131 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvhtb" podUID="c5149745-96d8-4185-aec6-3f0441bfe5a2" Jul 14 16:30:20.586973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.586942 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-95.ec2.internal" event="NodeReady" Jul 14 16:30:20.587125 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.587076 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 16:30:20.635129 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.635092 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f8bf88964-chjzm"] Jul 14 16:30:20.636867 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.636847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.642028 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.642001 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 16:30:20.642201 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.642120 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 16:30:20.642201 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.642138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l67zw\"" Jul 14 16:30:20.642362 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.642347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 16:30:20.654804 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.654774 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 16:30:20.658049 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.658021 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f8bf88964-chjzm"] Jul 14 16:30:20.662831 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.662802 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-94mms"] Jul 14 16:30:20.664670 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.664652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.668379 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.668353 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 16:30:20.668608 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.668589 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 16:30:20.668974 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.668959 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jq9rg\"" Jul 14 16:30:20.669273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.669258 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s429w"] Jul 14 16:30:20.671593 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.671575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.678868 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.678844 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 16:30:20.679033 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.679010 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tkzdw\"" Jul 14 16:30:20.679292 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.679275 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 16:30:20.679392 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.679355 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 16:30:20.685433 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.685390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s429w"] Jul 14 16:30:20.687722 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.687691 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-94mms"] Jul 14 16:30:20.746599 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.746557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:20.750656 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41a5459f-4641-41bc-9577-057bc555590f-cert\") pod \"ingress-canary-s429w\" (UID: \"41a5459f-4641-41bc-9577-057bc555590f\") " pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.750781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-image-registry-private-configuration\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.750781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2a41f28-0d9c-4a77-887f-7ea27df19af6-ca-trust-extracted\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.750781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6gnt\" (UniqueName: \"kubernetes.io/projected/41a5459f-4641-41bc-9577-057bc555590f-kube-api-access-c6gnt\") pod \"ingress-canary-s429w\" (UID: \"41a5459f-4641-41bc-9577-057bc555590f\") " pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.750781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-certificates\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.750781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2vfg\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-kube-api-access-f2vfg\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.750947 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngnt\" (UniqueName: \"kubernetes.io/projected/7818c2f5-46c7-4662-820b-051dff5254e4-kube-api-access-9ngnt\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.750947 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7818c2f5-46c7-4662-820b-051dff5254e4-config-volume\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.750947 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-trusted-ca\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.750947 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-bound-sa-token\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.751063 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.751063 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.750990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7818c2f5-46c7-4662-820b-051dff5254e4-tmp-dir\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.751063 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.751028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.751063 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.751046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-installation-pull-secrets\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.852268 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6gnt\" (UniqueName: \"kubernetes.io/projected/41a5459f-4641-41bc-9577-057bc555590f-kube-api-access-c6gnt\") pod \"ingress-canary-s429w\" (UID: \"41a5459f-4641-41bc-9577-057bc555590f\") " pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.852268 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-certificates\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.852268 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2vfg\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-kube-api-access-f2vfg\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngnt\" (UniqueName: \"kubernetes.io/projected/7818c2f5-46c7-4662-820b-051dff5254e4-kube-api-access-9ngnt\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7818c2f5-46c7-4662-820b-051dff5254e4-config-volume\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-trusted-ca\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-bound-sa-token\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7818c2f5-46c7-4662-820b-051dff5254e4-tmp-dir\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:20.852842 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:20.852851 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:20.852924 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:21.352904953 +0000 UTC m=+37.083278448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:20.852858 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-certificates\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.852951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-installation-pull-secrets\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853102 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:20.852996 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:21.352978534 +0000 UTC m=+37.083352032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:20.853734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.853034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7818c2f5-46c7-4662-820b-051dff5254e4-config-volume\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.853734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.853433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41a5459f-4641-41bc-9577-057bc555590f-cert\") pod \"ingress-canary-s429w\" (UID: \"41a5459f-4641-41bc-9577-057bc555590f\") " pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.853734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.853484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-image-registry-private-configuration\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.853734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.853342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7818c2f5-46c7-4662-820b-051dff5254e4-tmp-dir\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.853734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.853523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2a41f28-0d9c-4a77-887f-7ea27df19af6-ca-trust-extracted\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.854219 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.853987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2a41f28-0d9c-4a77-887f-7ea27df19af6-ca-trust-extracted\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.854466 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.854446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-trusted-ca\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.859031 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.859000 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-image-registry-private-configuration\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.859031 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.859008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41a5459f-4641-41bc-9577-057bc555590f-cert\") pod \"ingress-canary-s429w\" (UID: \"41a5459f-4641-41bc-9577-057bc555590f\") " pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.859237 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.859137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-installation-pull-secrets\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.865891 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.865859 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6gnt\" (UniqueName: \"kubernetes.io/projected/41a5459f-4641-41bc-9577-057bc555590f-kube-api-access-c6gnt\") pod \"ingress-canary-s429w\" (UID: \"41a5459f-4641-41bc-9577-057bc555590f\") " pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.868531 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.868501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngnt\" (UniqueName: \"kubernetes.io/projected/7818c2f5-46c7-4662-820b-051dff5254e4-kube-api-access-9ngnt\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:20.868863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.868824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:20.869234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.869208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2vfg\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-kube-api-access-f2vfg\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.869832 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.869812 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-bound-sa-token\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:20.980920 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.980878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s429w" Jul 14 16:30:20.987964 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.987931 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a14939d-b812-4492-a577-06a8be969715" containerID="d9bd26db7d2d71e8498d433f81af13b0b454d8921f86d3a4548b4fca326cfc3b" exitCode=0 Jul 14 16:30:20.988144 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:20.987982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerDied","Data":"d9bd26db7d2d71e8498d433f81af13b0b454d8921f86d3a4548b4fca326cfc3b"} Jul 14 16:30:21.146467 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.146256 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s429w"] Jul 14 16:30:21.154364 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:21.154324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a5459f_4641_41bc_9577_057bc555590f.slice/crio-d8dcd535d318120af1e2d7b956f6e9fa721ded202dc759782c0a92bd7a6804db WatchSource:0}: Error finding container d8dcd535d318120af1e2d7b956f6e9fa721ded202dc759782c0a92bd7a6804db: Status 404 returned error can't find the container with id d8dcd535d318120af1e2d7b956f6e9fa721ded202dc759782c0a92bd7a6804db Jul 14 16:30:21.357545 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.357452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:21.357545 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.357507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:21.357726 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:21.357605 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:21.357726 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:21.357667 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:22.357648558 +0000 UTC m=+38.088022053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:21.357726 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:21.357612 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:21.357726 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:21.357691 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:21.357726 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:21.357717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:22.35771085 +0000 UTC m=+38.088084345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:21.829654 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.829610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:21.829830 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.829672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:21.830007 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.829989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:21.832831 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.832807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 16:30:21.834555 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.834533 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 16:30:21.834681 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.834577 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 16:30:21.834681 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.834535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2hfc\"" Jul 14 16:30:21.834681 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.834535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cr5gm\"" Jul 14 16:30:21.834681 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.834539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 16:30:21.992053 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.992004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s429w" event={"ID":"41a5459f-4641-41bc-9577-057bc555590f","Type":"ContainerStarted","Data":"d8dcd535d318120af1e2d7b956f6e9fa721ded202dc759782c0a92bd7a6804db"} Jul 14 16:30:21.996135 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.996089 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a14939d-b812-4492-a577-06a8be969715" containerID="18d4005207373a114698a690c605588146347248ac01d92805101b126665ffe2" exitCode=0 Jul 14 16:30:21.996135 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:21.996135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerDied","Data":"18d4005207373a114698a690c605588146347248ac01d92805101b126665ffe2"} Jul 14 16:30:22.365327 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:22.365069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:22.365327 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:22.365318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:22.365587 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:22.365225 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:22.365587 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:22.365361 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:22.365587 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:22.365437 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:22.365587 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:22.365448 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:24.365427211 +0000 UTC m=+40.095800723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:22.365587 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:22.365478 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:24.365467048 +0000 UTC m=+40.095840544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:23.003554 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:23.003514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" event={"ID":"7a14939d-b812-4492-a577-06a8be969715","Type":"ContainerStarted","Data":"d1fdf138d1f07783989b0300e6e87a37dc9be088959bac19e78e9d3ef060045d"} Jul 14 16:30:23.036306 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:23.036242 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xvnvb" podStartSLOduration=13.693688436 podStartE2EDuration="39.036222705s" totalImagesPullingTime="25.342534269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:23.034305848 +0000 UTC m=+38.764679394" watchObservedRunningTime="2026-07-14 16:30:23.036222705 +0000 UTC m=+38.766596200" Jul 14 16:30:23.175419 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:23.175308 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:23.274323 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:23.274228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:24.383386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:24.383344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:24.383909 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:24.383506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:24.383909 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:24.383529 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:24.383909 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:24.383608 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:28.383584923 +0000 UTC m=+44.113958434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:24.383909 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:24.383607 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:24.383909 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:24.383630 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:24.383909 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:24.383686 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:28.383669624 +0000 UTC m=+44.114043120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:25.009950 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:25.009918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s429w" event={"ID":"41a5459f-4641-41bc-9577-057bc555590f","Type":"ContainerStarted","Data":"df08204c3a01cf5126c20b63f03d3478fb516f01a141aa6af357a04074b2df3a"} Jul 14 16:30:25.029419 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:25.029343 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s429w" podStartSLOduration=1.566125292 podStartE2EDuration="5.029326133s" totalImagesPullingTime="3.463200841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:25.028621688 +0000 UTC m=+40.758995223" watchObservedRunningTime="2026-07-14 16:30:25.029326133 +0000 UTC m=+40.759699651" Jul 14 16:30:25.259912 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:25.259878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:25.360014 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:25.359920 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:28.140710 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:28.140671 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:28.230440 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:28.230379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:28.416282 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:28.416191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:28.416487 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:28.416328 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:28.416487 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:28.416341 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:28.416487 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:28.416362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:28.416487 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:28.416388 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:36.416375039 +0000 UTC m=+52.146748535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:28.416487 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:28.416485 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:28.416700 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:28.416543 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:36.41652776 +0000 UTC m=+52.146901256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:31.808867 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:31.808825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:31.908285 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:31.908228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:32.008782 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:32.008749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:32.705477 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:32.705384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:32.795396 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:32.795360 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:32.897635 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:32.897581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:34.511089 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:34.511057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:34.586261 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:34.586224 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:34.687457 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:34.687420 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:36.423270 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.423234 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x"] Jul 14 16:30:36.436619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.436579 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d7m55"] Jul 14 16:30:36.436777 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.436696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.450738 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.450696 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f7c99c78d-j4xhp"] Jul 14 16:30:36.450865 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.450845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.450911 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.450890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.452747 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.452721 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 16:30:36.452924 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.452791 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 16:30:36.453038 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.452805 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.453038 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.452809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gsk2t\"" Jul 14 16:30:36.456512 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.456490 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.456709 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.456689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.456788 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.456725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 16:30:36.456923 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.456900 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pzqhw\"" Jul 14 16:30:36.456923 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.456927 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 16:30:36.462743 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.462717 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 16:30:36.472611 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.472580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x"] Jul 14 16:30:36.472749 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.472620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f7c99c78d-j4xhp"] Jul 14 16:30:36.472749 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.472639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d7m55"] Jul 14 16:30:36.472749 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.472693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.476930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.476903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 16:30:36.476930 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.476927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 16:30:36.477301 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 16:30:36.477361 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477329 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.477361 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb95d0c-006f-47b2-bb48-182ad2df3c57-tmp\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.477472 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477389 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 16:30:36.477472 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-default-certificate\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.477581 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.477581 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-stats-auth\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.477581 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477615 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb95d0c-006f-47b2-bb48-182ad2df3c57-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkfhp\" (UniqueName: \"kubernetes.io/projected/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-kube-api-access-fkfhp\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.477664 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb95d0c-006f-47b2-bb48-182ad2df3c57-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.477727 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.477730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.477709535 +0000 UTC m=+68.208083031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb95d0c-006f-47b2-bb48-182ad2df3c57-serving-cert\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.477927 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.477943 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4mct4\"" Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.477984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz8b5\" (UniqueName: \"kubernetes.io/projected/0eb95d0c-006f-47b2-bb48-182ad2df3c57-kube-api-access-pz8b5\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.477992 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.477974401 +0000 UTC m=+68.208347899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:36.478036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.478025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0eb95d0c-006f-47b2-bb48-182ad2df3c57-snapshots\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.478356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.478056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.478356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.478111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7zb6\" (UniqueName: \"kubernetes.io/projected/fa89f02a-149d-4402-9298-107d463f876f-kube-api-access-h7zb6\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.527931 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.527895 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr"] Jul 14 16:30:36.552631 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.552589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr"] Jul 14 16:30:36.552631 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.552622 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.556339 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.556317 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 16:30:36.556536 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.556516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 16:30:36.556598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.556559 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kxpcn\"" Jul 14 16:30:36.556898 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.556865 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.556986 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.556946 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.579033 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.578994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb95d0c-006f-47b2-bb48-182ad2df3c57-tmp\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.579033 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-default-certificate\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.579273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.579273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e16dc1-7631-43c3-bd46-309850fd6b04-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.579273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-stats-auth\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.579273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb95d0c-006f-47b2-bb48-182ad2df3c57-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.579273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0e16dc1-7631-43c3-bd46-309850fd6b04-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42tg\" (UniqueName: \"kubernetes.io/projected/c0e16dc1-7631-43c3-bd46-309850fd6b04-kube-api-access-c42tg\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.579314 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.579370 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:37.079354589 +0000 UTC m=+52.809728084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : secret "router-metrics-certs-default" not found Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkfhp\" (UniqueName: \"kubernetes.io/projected/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-kube-api-access-fkfhp\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb95d0c-006f-47b2-bb48-182ad2df3c57-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579449 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb95d0c-006f-47b2-bb48-182ad2df3c57-tmp\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.579543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.579838 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.579598 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:36.579838 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.579605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.579838 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.579643 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls podName:9c8f795f-c8cd-4f69-a876-e9f5a114b58d nodeName:}" failed. No retries permitted until 2026-07-14 16:30:37.079629686 +0000 UTC m=+52.810003184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zfc5x" (UID: "9c8f795f-c8cd-4f69-a876-e9f5a114b58d") : secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:36.580080 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.580048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb95d0c-006f-47b2-bb48-182ad2df3c57-serving-cert\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.580154 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.580116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz8b5\" (UniqueName: \"kubernetes.io/projected/0eb95d0c-006f-47b2-bb48-182ad2df3c57-kube-api-access-pz8b5\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.580209 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.580151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0eb95d0c-006f-47b2-bb48-182ad2df3c57-snapshots\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.580209 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.580190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.580483 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.580446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7zb6\" (UniqueName: \"kubernetes.io/projected/fa89f02a-149d-4402-9298-107d463f876f-kube-api-access-h7zb6\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.581175 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.581067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb95d0c-006f-47b2-bb48-182ad2df3c57-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.581175 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.581162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb95d0c-006f-47b2-bb48-182ad2df3c57-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.582315 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.582283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.583757 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.583741 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:37.083683744 +0000 UTC m=+52.814057243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : configmap references non-existent config key: service-ca.crt Jul 14 16:30:36.584887 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.584864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0eb95d0c-006f-47b2-bb48-182ad2df3c57-snapshots\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.585257 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.585237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-default-certificate\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.586047 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.586022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eb95d0c-006f-47b2-bb48-182ad2df3c57-serving-cert\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.586251 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.586235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-stats-auth\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.589566 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.589544 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkfhp\" (UniqueName: \"kubernetes.io/projected/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-kube-api-access-fkfhp\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:36.592187 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.592162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7zb6\" (UniqueName: \"kubernetes.io/projected/fa89f02a-149d-4402-9298-107d463f876f-kube-api-access-h7zb6\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:36.592653 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.592635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz8b5\" (UniqueName: \"kubernetes.io/projected/0eb95d0c-006f-47b2-bb48-182ad2df3c57-kube-api-access-pz8b5\") pod \"insights-operator-68d9dd94cf-d7m55\" (UID: \"0eb95d0c-006f-47b2-bb48-182ad2df3c57\") " pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.633299 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.633260 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-xgcjz"] Jul 14 16:30:36.663183 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.663150 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x"] Jul 14 16:30:36.663363 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.663279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.666079 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.666043 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 16:30:36.666222 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.666175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.666282 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.666236 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-n6gwr\"" Jul 14 16:30:36.666390 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.666376 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.666466 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.666382 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 16:30:36.671122 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.671103 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 16:30:36.681744 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e16dc1-7631-43c3-bd46-309850fd6b04-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.681887 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0e16dc1-7631-43c3-bd46-309850fd6b04-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.681887 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42tg\" (UniqueName: \"kubernetes.io/projected/c0e16dc1-7631-43c3-bd46-309850fd6b04-kube-api-access-c42tg\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.681887 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a52d3a93-6f57-49bc-8975-79ef0918907a-trusted-ca\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.682046 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a52d3a93-6f57-49bc-8975-79ef0918907a-serving-cert\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.682046 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ddws\" (UniqueName: \"kubernetes.io/projected/a52d3a93-6f57-49bc-8975-79ef0918907a-kube-api-access-7ddws\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.682046 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.681965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a52d3a93-6f57-49bc-8975-79ef0918907a-config\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.682318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.682297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0e16dc1-7631-43c3-bd46-309850fd6b04-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.684062 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.684041 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e16dc1-7631-43c3-bd46-309850fd6b04-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.686973 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.686951 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6"] Jul 14 16:30:36.687081 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.687067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" Jul 14 16:30:36.691007 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.690983 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.691279 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.691253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.691350 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.691254 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mmglz\"" Jul 14 16:30:36.693283 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.693262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42tg\" (UniqueName: \"kubernetes.io/projected/c0e16dc1-7631-43c3-bd46-309850fd6b04-kube-api-access-c42tg\") pod \"kube-storage-version-migrator-operator-799cb7f958-sl7nr\" (UID: \"c0e16dc1-7631-43c3-bd46-309850fd6b04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.711241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.711210 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xgcjz"] Jul 14 16:30:36.711241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.711248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x"] Jul 14 16:30:36.711476 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.711327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:36.711476 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.711343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6"] Jul 14 16:30:36.714880 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.714857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 16:30:36.715391 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.715376 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-snzcb\"" Jul 14 16:30:36.715489 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.715472 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:36.715741 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.715725 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:36.761478 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.761442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" Jul 14 16:30:36.783050 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:36.783211 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dc82\" (UniqueName: \"kubernetes.io/projected/3cfa9a63-81d5-408e-903d-0597b9588e97-kube-api-access-6dc82\") pod \"volume-data-source-validator-78495597f6-vvr4x\" (UID: \"3cfa9a63-81d5-408e-903d-0597b9588e97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" Jul 14 16:30:36.783211 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a52d3a93-6f57-49bc-8975-79ef0918907a-trusted-ca\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.783211 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwwkk\" (UniqueName: \"kubernetes.io/projected/0d77f00e-6a05-480b-8139-e797e83a5597-kube-api-access-jwwkk\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:36.783367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a52d3a93-6f57-49bc-8975-79ef0918907a-serving-cert\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.783367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ddws\" (UniqueName: \"kubernetes.io/projected/a52d3a93-6f57-49bc-8975-79ef0918907a-kube-api-access-7ddws\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.783367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a52d3a93-6f57-49bc-8975-79ef0918907a-config\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.784232 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.783928 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a52d3a93-6f57-49bc-8975-79ef0918907a-config\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.784232 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.784076 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a52d3a93-6f57-49bc-8975-79ef0918907a-trusted-ca\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.785765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.785743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a52d3a93-6f57-49bc-8975-79ef0918907a-serving-cert\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.794199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.794168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ddws\" (UniqueName: \"kubernetes.io/projected/a52d3a93-6f57-49bc-8975-79ef0918907a-kube-api-access-7ddws\") pod \"console-operator-7866497494-xgcjz\" (UID: \"a52d3a93-6f57-49bc-8975-79ef0918907a\") " pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:36.861916 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.861841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" Jul 14 16:30:36.884671 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.884641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:36.884855 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.884688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dc82\" (UniqueName: \"kubernetes.io/projected/3cfa9a63-81d5-408e-903d-0597b9588e97-kube-api-access-6dc82\") pod \"volume-data-source-validator-78495597f6-vvr4x\" (UID: \"3cfa9a63-81d5-408e-903d-0597b9588e97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" Jul 14 16:30:36.884855 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.884804 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 16:30:36.884972 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.884862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwwkk\" (UniqueName: \"kubernetes.io/projected/0d77f00e-6a05-480b-8139-e797e83a5597-kube-api-access-jwwkk\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:36.884972 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:36.884874 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls podName:0d77f00e-6a05-480b-8139-e797e83a5597 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:37.384854586 +0000 UTC m=+53.115228095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls") pod "cluster-samples-operator-65db858894-zgcn6" (UID: "0d77f00e-6a05-480b-8139-e797e83a5597") : secret "samples-operator-tls" not found Jul 14 16:30:36.895152 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.895121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwwkk\" (UniqueName: \"kubernetes.io/projected/0d77f00e-6a05-480b-8139-e797e83a5597-kube-api-access-jwwkk\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:36.895566 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.895547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dc82\" (UniqueName: \"kubernetes.io/projected/3cfa9a63-81d5-408e-903d-0597b9588e97-kube-api-access-6dc82\") pod \"volume-data-source-validator-78495597f6-vvr4x\" (UID: \"3cfa9a63-81d5-408e-903d-0597b9588e97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" Jul 14 16:30:36.911201 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.911115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d7m55"] Jul 14 16:30:36.914178 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:36.914148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb95d0c_006f_47b2_bb48_182ad2df3c57.slice/crio-e1904559c8572ff0c8281b0843b92d1783e2b48de5e3f2af493204718ef8d6bb WatchSource:0}: Error finding container e1904559c8572ff0c8281b0843b92d1783e2b48de5e3f2af493204718ef8d6bb: Status 404 returned error can't find the container with id e1904559c8572ff0c8281b0843b92d1783e2b48de5e3f2af493204718ef8d6bb Jul 14 16:30:36.972691 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:36.972653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:37.001377 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.001346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" Jul 14 16:30:37.017682 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.017647 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr"] Jul 14 16:30:37.020722 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:37.020691 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e16dc1_7631_43c3_bd46_309850fd6b04.slice/crio-957322b1c0b526bb3adb9b85e5aed302740dcfc754a685dee8a712c58a3cf7b8 WatchSource:0}: Error finding container 957322b1c0b526bb3adb9b85e5aed302740dcfc754a685dee8a712c58a3cf7b8: Status 404 returned error can't find the container with id 957322b1c0b526bb3adb9b85e5aed302740dcfc754a685dee8a712c58a3cf7b8 Jul 14 16:30:37.039705 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.039667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" event={"ID":"c0e16dc1-7631-43c3-bd46-309850fd6b04","Type":"ContainerStarted","Data":"957322b1c0b526bb3adb9b85e5aed302740dcfc754a685dee8a712c58a3cf7b8"} Jul 14 16:30:37.042748 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.042709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" event={"ID":"0eb95d0c-006f-47b2-bb48-182ad2df3c57","Type":"ContainerStarted","Data":"e1904559c8572ff0c8281b0843b92d1783e2b48de5e3f2af493204718ef8d6bb"} Jul 14 16:30:37.087291 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.087246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:37.087446 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.087323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:37.087446 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.087394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:37.087568 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.087459 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:37.087568 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.087505 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 16:30:37.087568 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.087527 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls podName:9c8f795f-c8cd-4f69-a876-e9f5a114b58d nodeName:}" failed. No retries permitted until 2026-07-14 16:30:38.087507378 +0000 UTC m=+53.817880888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zfc5x" (UID: "9c8f795f-c8cd-4f69-a876-e9f5a114b58d") : secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:37.087568 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.087546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:38.08753591 +0000 UTC m=+53.817909410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : secret "router-metrics-certs-default" not found Jul 14 16:30:37.087568 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.087559 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:38.087552139 +0000 UTC m=+53.817925634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : configmap references non-existent config key: service-ca.crt Jul 14 16:30:37.158378 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.158342 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xgcjz"] Jul 14 16:30:37.161529 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:37.161502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52d3a93_6f57_49bc_8975_79ef0918907a.slice/crio-859df5d05bf4ccf4f0a9f1b606836db00b7eae650202621fccb9eb77884794f5 WatchSource:0}: Error finding container 859df5d05bf4ccf4f0a9f1b606836db00b7eae650202621fccb9eb77884794f5: Status 404 returned error can't find the container with id 859df5d05bf4ccf4f0a9f1b606836db00b7eae650202621fccb9eb77884794f5 Jul 14 16:30:37.169959 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.169935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x"] Jul 14 16:30:37.173153 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:37.173130 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfa9a63_81d5_408e_903d_0597b9588e97.slice/crio-cd89785dd914397873084b5d7ffdb82ed96141c0a4fe49b228e7f268dda6a282 WatchSource:0}: Error finding container cd89785dd914397873084b5d7ffdb82ed96141c0a4fe49b228e7f268dda6a282: Status 404 returned error can't find the container with id cd89785dd914397873084b5d7ffdb82ed96141c0a4fe49b228e7f268dda6a282 Jul 14 16:30:37.250682 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.250640 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:37.351668 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.351629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:37.390633 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.390603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:37.390767 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.390754 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 16:30:37.390827 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:37.390816 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls podName:0d77f00e-6a05-480b-8139-e797e83a5597 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:38.390801033 +0000 UTC m=+54.121174529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls") pod "cluster-samples-operator-65db858894-zgcn6" (UID: "0d77f00e-6a05-480b-8139-e797e83a5597") : secret "samples-operator-tls" not found Jul 14 16:30:37.514545 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.514464 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r"] Jul 14 16:30:37.547913 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.547870 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r"] Jul 14 16:30:37.548069 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.548000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.551671 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.551623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:30:37.551869 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.551689 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 16:30:37.551869 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.551822 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9vn87\"" Jul 14 16:30:37.551970 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.551880 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 16:30:37.551970 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.551927 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 16:30:37.592285 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.592250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/161661ad-b571-41df-937c-ac21eb815c2a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.592492 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.592397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpff6\" (UniqueName: \"kubernetes.io/projected/161661ad-b571-41df-937c-ac21eb815c2a-kube-api-access-cpff6\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.592574 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.592501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161661ad-b571-41df-937c-ac21eb815c2a-config\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.693291 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.693249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161661ad-b571-41df-937c-ac21eb815c2a-config\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.693519 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.693309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/161661ad-b571-41df-937c-ac21eb815c2a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.693596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.693526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpff6\" (UniqueName: \"kubernetes.io/projected/161661ad-b571-41df-937c-ac21eb815c2a-kube-api-access-cpff6\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.693897 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.693872 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/161661ad-b571-41df-937c-ac21eb815c2a-config\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.695661 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.695640 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/161661ad-b571-41df-937c-ac21eb815c2a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.708989 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.708961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpff6\" (UniqueName: \"kubernetes.io/projected/161661ad-b571-41df-937c-ac21eb815c2a-kube-api-access-cpff6\") pod \"service-ca-operator-7695fc6c8c-5428r\" (UID: \"161661ad-b571-41df-937c-ac21eb815c2a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:37.856753 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:37.856663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" Jul 14 16:30:38.001006 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.000973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r"] Jul 14 16:30:38.003839 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:38.003806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161661ad_b571_41df_937c_ac21eb815c2a.slice/crio-ae39718a9493af076a3c17b3ddd9d1dfcd78e99ff229bf4b0f78d686a28afc46 WatchSource:0}: Error finding container ae39718a9493af076a3c17b3ddd9d1dfcd78e99ff229bf4b0f78d686a28afc46: Status 404 returned error can't find the container with id ae39718a9493af076a3c17b3ddd9d1dfcd78e99ff229bf4b0f78d686a28afc46 Jul 14 16:30:38.046048 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.046012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" event={"ID":"161661ad-b571-41df-937c-ac21eb815c2a","Type":"ContainerStarted","Data":"ae39718a9493af076a3c17b3ddd9d1dfcd78e99ff229bf4b0f78d686a28afc46"} Jul 14 16:30:38.047128 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.047104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" event={"ID":"3cfa9a63-81d5-408e-903d-0597b9588e97","Type":"ContainerStarted","Data":"cd89785dd914397873084b5d7ffdb82ed96141c0a4fe49b228e7f268dda6a282"} Jul 14 16:30:38.048123 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.048103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xgcjz" event={"ID":"a52d3a93-6f57-49bc-8975-79ef0918907a","Type":"ContainerStarted","Data":"859df5d05bf4ccf4f0a9f1b606836db00b7eae650202621fccb9eb77884794f5"} Jul 14 16:30:38.096965 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.096922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:38.097141 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.096990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:38.097141 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.097064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:38.097141 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.097068 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:38.097263 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.097144 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 16:30:38.097263 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.097202 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls podName:9c8f795f-c8cd-4f69-a876-e9f5a114b58d nodeName:}" failed. No retries permitted until 2026-07-14 16:30:40.097187166 +0000 UTC m=+55.827560676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zfc5x" (UID: "9c8f795f-c8cd-4f69-a876-e9f5a114b58d") : secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:38.097263 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.097217 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:40.097210323 +0000 UTC m=+55.827583818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : secret "router-metrics-certs-default" not found Jul 14 16:30:38.097263 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.097227 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:40.097222036 +0000 UTC m=+55.827595532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : configmap references non-existent config key: service-ca.crt Jul 14 16:30:38.307626 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.307594 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b"] Jul 14 16:30:38.342488 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.342452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b"] Jul 14 16:30:38.342649 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.342555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" Jul 14 16:30:38.347020 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.346999 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8vrmz\"" Jul 14 16:30:38.399300 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.399260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:38.399510 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.399346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfpss\" (UniqueName: \"kubernetes.io/projected/870a55b8-14c4-46e4-9df1-5235893f97f3-kube-api-access-mfpss\") pod \"network-check-source-869dcfcdcd-xt95b\" (UID: \"870a55b8-14c4-46e4-9df1-5235893f97f3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" Jul 14 16:30:38.399510 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.399422 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 16:30:38.399510 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:38.399485 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls podName:0d77f00e-6a05-480b-8139-e797e83a5597 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:40.399468087 +0000 UTC m=+56.129841584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls") pod "cluster-samples-operator-65db858894-zgcn6" (UID: "0d77f00e-6a05-480b-8139-e797e83a5597") : secret "samples-operator-tls" not found Jul 14 16:30:38.500122 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.500080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfpss\" (UniqueName: \"kubernetes.io/projected/870a55b8-14c4-46e4-9df1-5235893f97f3-kube-api-access-mfpss\") pod \"network-check-source-869dcfcdcd-xt95b\" (UID: \"870a55b8-14c4-46e4-9df1-5235893f97f3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" Jul 14 16:30:38.510189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.510161 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfpss\" (UniqueName: \"kubernetes.io/projected/870a55b8-14c4-46e4-9df1-5235893f97f3-kube-api-access-mfpss\") pod \"network-check-source-869dcfcdcd-xt95b\" (UID: \"870a55b8-14c4-46e4-9df1-5235893f97f3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" Jul 14 16:30:38.651654 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.651566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" Jul 14 16:30:38.808139 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:38.808046 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b"] Jul 14 16:30:38.810807 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:38.810772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870a55b8_14c4_46e4_9df1_5235893f97f3.slice/crio-9ed33ae3a709907c0f2c82640b7cada48b6c4cb34b73f0c9303f7b4601e20833 WatchSource:0}: Error finding container 9ed33ae3a709907c0f2c82640b7cada48b6c4cb34b73f0c9303f7b4601e20833: Status 404 returned error can't find the container with id 9ed33ae3a709907c0f2c82640b7cada48b6c4cb34b73f0c9303f7b4601e20833 Jul 14 16:30:39.052169 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:39.052132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" event={"ID":"870a55b8-14c4-46e4-9df1-5235893f97f3","Type":"ContainerStarted","Data":"9ed33ae3a709907c0f2c82640b7cada48b6c4cb34b73f0c9303f7b4601e20833"} Jul 14 16:30:40.057775 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:40.057738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" event={"ID":"3cfa9a63-81d5-408e-903d-0597b9588e97","Type":"ContainerStarted","Data":"4ca144dbe8f446df2c79d34d09e686643badc149366fa2c11c7332dba1201bfb"} Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:40.116603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:40.116684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:40.116763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.116904 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.116962 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:44.11694483 +0000 UTC m=+59.847318331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : secret "router-metrics-certs-default" not found Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.117659 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:40.117759 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.117721 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls podName:9c8f795f-c8cd-4f69-a876-e9f5a114b58d nodeName:}" failed. No retries permitted until 2026-07-14 16:30:44.117703311 +0000 UTC m=+59.848076823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zfc5x" (UID: "9c8f795f-c8cd-4f69-a876-e9f5a114b58d") : secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:40.118298 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.117803 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:44.11778947 +0000 UTC m=+59.848162968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : configmap references non-existent config key: service-ca.crt Jul 14 16:30:40.174883 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:40.174510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:40.420183 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:40.420098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:40.420354 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.420289 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 16:30:40.420354 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:40.420353 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls podName:0d77f00e-6a05-480b-8139-e797e83a5597 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:44.420334814 +0000 UTC m=+60.150708313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls") pod "cluster-samples-operator-65db858894-zgcn6" (UID: "0d77f00e-6a05-480b-8139-e797e83a5597") : secret "samples-operator-tls" not found Jul 14 16:30:44.070721 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.070687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/0.log" Jul 14 16:30:44.071210 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.070736 2576 generic.go:356] "Generic (PLEG): container finished" podID="a52d3a93-6f57-49bc-8975-79ef0918907a" containerID="7d2a430966318c7b0113072e3034fa14eb00fe8247abfcd537a79f83e71cb695" exitCode=255 Jul 14 16:30:44.071210 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.070817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xgcjz" event={"ID":"a52d3a93-6f57-49bc-8975-79ef0918907a","Type":"ContainerDied","Data":"7d2a430966318c7b0113072e3034fa14eb00fe8247abfcd537a79f83e71cb695"} Jul 14 16:30:44.071210 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.071103 2576 scope.go:117] "RemoveContainer" containerID="7d2a430966318c7b0113072e3034fa14eb00fe8247abfcd537a79f83e71cb695" Jul 14 16:30:44.073154 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.073123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" event={"ID":"870a55b8-14c4-46e4-9df1-5235893f97f3","Type":"ContainerStarted","Data":"fb3e1c6fb6c2b663b1cf71cc218872a358482b400565395965ac2ca063782935"} Jul 14 16:30:44.074868 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.074779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" event={"ID":"0eb95d0c-006f-47b2-bb48-182ad2df3c57","Type":"ContainerStarted","Data":"f37b44224c762aa11aad1f22fd977b910d13a2c044f0e8cfaed599cb7118ce18"} Jul 14 16:30:44.082597 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.082177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" event={"ID":"c0e16dc1-7631-43c3-bd46-309850fd6b04","Type":"ContainerStarted","Data":"50863d01c49af51888ff0fc27380e1f02860179383612f5018b19d1bb4dfb485"} Jul 14 16:30:44.084740 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.084720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" event={"ID":"161661ad-b571-41df-937c-ac21eb815c2a","Type":"ContainerStarted","Data":"160532f869964630c37f0a697b1ec91c2bf7b86d8623456cc96220a08b88541b"} Jul 14 16:30:44.097887 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.097839 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-vvr4x" podStartSLOduration=5.815523215 podStartE2EDuration="8.097818858s" totalImagesPullingTime="2.282295643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:40.077023932 +0000 UTC m=+55.807397451" watchObservedRunningTime="2026-07-14 16:30:44.097818858 +0000 UTC m=+59.828192377" Jul 14 16:30:44.133859 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.133793 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" podStartSLOduration=1.8849844089999999 podStartE2EDuration="8.133772552s" totalImagesPullingTime="6.248788143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:44.131759471 +0000 UTC m=+59.862132990" watchObservedRunningTime="2026-07-14 16:30:44.133772552 +0000 UTC m=+59.864146071" Jul 14 16:30:44.155701 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.155579 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" podStartSLOduration=1.836514789 podStartE2EDuration="8.155510423s" totalImagesPullingTime="6.318995634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:44.15525073 +0000 UTC m=+59.885624251" watchObservedRunningTime="2026-07-14 16:30:44.155510423 +0000 UTC m=+59.885883948" Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.156758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.156894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.157035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.158065 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.158046305 +0000 UTC m=+67.888419808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : configmap references non-existent config key: service-ca.crt Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.159215 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.159261 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.159247606 +0000 UTC m=+67.889621107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : secret "router-metrics-certs-default" not found Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.159470 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:44.160193 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.159506 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls podName:9c8f795f-c8cd-4f69-a876-e9f5a114b58d nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.159494222 +0000 UTC m=+67.889867720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zfc5x" (UID: "9c8f795f-c8cd-4f69-a876-e9f5a114b58d") : secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:44.180118 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.180058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" podStartSLOduration=1.950664673 podStartE2EDuration="7.18002431s" totalImagesPullingTime="5.229359637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:44.179232807 +0000 UTC m=+59.909606326" watchObservedRunningTime="2026-07-14 16:30:44.18002431 +0000 UTC m=+59.910397829" Jul 14 16:30:44.199596 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.199506 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-xt95b" podStartSLOduration=1.7777221079999999 podStartE2EDuration="6.199469731s" totalImagesPullingTime="4.421747623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:44.197721054 +0000 UTC m=+59.928094573" watchObservedRunningTime="2026-07-14 16:30:44.199469731 +0000 UTC m=+59.929843250" Jul 14 16:30:44.408049 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.407962 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hkzns"] Jul 14 16:30:44.413980 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.413950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.416698 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.416674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 16:30:44.416929 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.416906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 16:30:44.417350 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.417328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbmcg\"" Jul 14 16:30:44.433994 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.433970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hkzns"] Jul 14 16:30:44.459833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.459798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:44.459981 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.459894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/643fe84c-dff9-4186-b603-636ba30072ed-data-volume\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.459981 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.459926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.459981 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.459956 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 16:30:44.460126 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.459989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/643fe84c-dff9-4186-b603-636ba30072ed-crio-socket\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.460126 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.460014 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzx9j\" (UniqueName: \"kubernetes.io/projected/643fe84c-dff9-4186-b603-636ba30072ed-kube-api-access-dzx9j\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.460126 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.460029 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls podName:0d77f00e-6a05-480b-8139-e797e83a5597 nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.460008267 +0000 UTC m=+68.190381771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls") pod "cluster-samples-operator-65db858894-zgcn6" (UID: "0d77f00e-6a05-480b-8139-e797e83a5597") : secret "samples-operator-tls" not found Jul 14 16:30:44.460250 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.460201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.474203 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.474172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:44.561646 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/643fe84c-dff9-4186-b603-636ba30072ed-data-volume\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.561646 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.561886 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/643fe84c-dff9-4186-b603-636ba30072ed-crio-socket\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.561886 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzx9j\" (UniqueName: \"kubernetes.io/projected/643fe84c-dff9-4186-b603-636ba30072ed-kube-api-access-dzx9j\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.561886 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.561886 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561819 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/643fe84c-dff9-4186-b603-636ba30072ed-crio-socket\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.561886 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.561838 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:44.562101 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.561900 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:44.562101 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.561909 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.061889243 +0000 UTC m=+60.792262743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:44.562101 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:44.561955 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:45.061940244 +0000 UTC m=+60.792313748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : configmap "kube-rbac-proxy" not found Jul 14 16:30:44.562101 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.561996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/643fe84c-dff9-4186-b603-636ba30072ed-data-volume\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.574822 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.574797 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzx9j\" (UniqueName: \"kubernetes.io/projected/643fe84c-dff9-4186-b603-636ba30072ed-kube-api-access-dzx9j\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:44.606006 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.605972 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:44.986101 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:44.986072 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cn9dd" Jul 14 16:30:45.066005 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.065965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:45.066199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.066107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:45.066199 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:45.066132 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:45.066309 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:45.066211 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.066190867 +0000 UTC m=+61.796564366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : configmap "kube-rbac-proxy" not found Jul 14 16:30:45.066309 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:45.066247 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:45.066309 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:45.066295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:46.066281122 +0000 UTC m=+61.796654618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:45.090142 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.090115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:30:45.090589 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.090572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/0.log" Jul 14 16:30:45.090666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.090617 2576 generic.go:356] "Generic (PLEG): container finished" podID="a52d3a93-6f57-49bc-8975-79ef0918907a" containerID="6bab12af34238985d54fe27c7ed956daa49b8e75fb9dfdf12c8d2ffc4e1ee7c7" exitCode=255 Jul 14 16:30:45.090740 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.090709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xgcjz" event={"ID":"a52d3a93-6f57-49bc-8975-79ef0918907a","Type":"ContainerDied","Data":"6bab12af34238985d54fe27c7ed956daa49b8e75fb9dfdf12c8d2ffc4e1ee7c7"} Jul 14 16:30:45.090815 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.090803 2576 scope.go:117] "RemoveContainer" containerID="7d2a430966318c7b0113072e3034fa14eb00fe8247abfcd537a79f83e71cb695" Jul 14 16:30:45.091061 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.091039 2576 scope.go:117] "RemoveContainer" containerID="6bab12af34238985d54fe27c7ed956daa49b8e75fb9dfdf12c8d2ffc4e1ee7c7" Jul 14 16:30:45.091250 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:45.091224 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xgcjz_openshift-console-operator(a52d3a93-6f57-49bc-8975-79ef0918907a)\"" pod="openshift-console-operator/console-operator-7866497494-xgcjz" podUID="a52d3a93-6f57-49bc-8975-79ef0918907a" Jul 14 16:30:45.166474 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.166433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:45.314670 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.314584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:45.406127 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.406094 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:45.483630 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.483592 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:45.700438 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.700350 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7p78q_a812f567-b022-43f6-8a27-48285783308f/dns-node-resolver/0.log" Jul 14 16:30:45.912117 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:45.912080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:46.013472 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.013440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:46.075897 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.075859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:46.076074 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.075953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:46.076074 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:46.075983 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:46.076074 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:46.076046 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.076030823 +0000 UTC m=+63.806404319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : configmap "kube-rbac-proxy" not found Jul 14 16:30:46.076074 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:46.076068 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:46.076241 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:46.076109 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:48.076098012 +0000 UTC m=+63.806471507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:46.094635 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.094610 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:30:46.095042 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.094983 2576 scope.go:117] "RemoveContainer" containerID="6bab12af34238985d54fe27c7ed956daa49b8e75fb9dfdf12c8d2ffc4e1ee7c7" Jul 14 16:30:46.095150 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:46.095132 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xgcjz_openshift-console-operator(a52d3a93-6f57-49bc-8975-79ef0918907a)\"" pod="openshift-console-operator/console-operator-7866497494-xgcjz" podUID="a52d3a93-6f57-49bc-8975-79ef0918907a" Jul 14 16:30:46.507093 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.507071 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j87mj_6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53/node-ca/0.log" Jul 14 16:30:46.818727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.818630 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:46.919609 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.919575 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:46.973151 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.973102 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:46.973303 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:46.973175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:30:47.098166 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.098098 2576 scope.go:117] "RemoveContainer" containerID="6bab12af34238985d54fe27c7ed956daa49b8e75fb9dfdf12c8d2ffc4e1ee7c7" Jul 14 16:30:47.098526 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:47.098248 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xgcjz_openshift-console-operator(a52d3a93-6f57-49bc-8975-79ef0918907a)\"" pod="openshift-console-operator/console-operator-7866497494-xgcjz" podUID="a52d3a93-6f57-49bc-8975-79ef0918907a" Jul 14 16:30:47.308494 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.308469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s429w_41a5459f-4641-41bc-9577-057bc555590f/serve-healthcheck-canary/0.log" Jul 14 16:30:47.500686 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.500654 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mw6cb"] Jul 14 16:30:47.503602 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.503584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.507030 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.507012 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 16:30:47.507202 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.507181 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 16:30:47.507357 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.507339 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xxvw7\"" Jul 14 16:30:47.507463 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.507376 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 16:30:47.508531 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.508517 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 16:30:47.511092 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.511070 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:47.514871 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.514850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mw6cb"] Jul 14 16:30:47.588789 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.588756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa32a7a6-c655-4d2f-a291-69fb51f9694a-signing-cabundle\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.588939 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.588806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa32a7a6-c655-4d2f-a291-69fb51f9694a-signing-key\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.588939 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.588843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vj7h\" (UniqueName: \"kubernetes.io/projected/fa32a7a6-c655-4d2f-a291-69fb51f9694a-kube-api-access-7vj7h\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.610133 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.610107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:47.690158 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.690117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa32a7a6-c655-4d2f-a291-69fb51f9694a-signing-cabundle\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.690313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.690174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa32a7a6-c655-4d2f-a291-69fb51f9694a-signing-key\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.690313 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.690201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vj7h\" (UniqueName: \"kubernetes.io/projected/fa32a7a6-c655-4d2f-a291-69fb51f9694a-kube-api-access-7vj7h\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.690780 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.690750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fa32a7a6-c655-4d2f-a291-69fb51f9694a-signing-cabundle\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.692519 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.692503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fa32a7a6-c655-4d2f-a291-69fb51f9694a-signing-key\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.700370 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.700350 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vj7h\" (UniqueName: \"kubernetes.io/projected/fa32a7a6-c655-4d2f-a291-69fb51f9694a-kube-api-access-7vj7h\") pod \"service-ca-79f68b9f4f-mw6cb\" (UID: \"fa32a7a6-c655-4d2f-a291-69fb51f9694a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.708757 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.708729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:47.812283 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.812205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" Jul 14 16:30:47.936366 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:47.936337 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mw6cb"] Jul 14 16:30:47.939058 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:47.939032 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa32a7a6_c655_4d2f_a291_69fb51f9694a.slice/crio-6112f1e6246756679657c2b7544c4d53cce901cca7eedadc910eebf37b8de1de WatchSource:0}: Error finding container 6112f1e6246756679657c2b7544c4d53cce901cca7eedadc910eebf37b8de1de: Status 404 returned error can't find the container with id 6112f1e6246756679657c2b7544c4d53cce901cca7eedadc910eebf37b8de1de Jul 14 16:30:48.093823 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:48.093738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:48.093993 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:48.093871 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:48.093993 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:48.093915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:48.093993 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:48.093946 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.093926074 +0000 UTC m=+67.824299574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : configmap "kube-rbac-proxy" not found Jul 14 16:30:48.093993 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:48.093991 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:48.094165 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:48.094039 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:30:52.094024594 +0000 UTC m=+67.824398090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:48.103568 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:48.103539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" event={"ID":"fa32a7a6-c655-4d2f-a291-69fb51f9694a","Type":"ContainerStarted","Data":"146644816f494110c3fb57a8dcc3bf9da35a76ae9bf9f80164d8e4b338c9d4b5"} Jul 14 16:30:48.103921 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:48.103593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" event={"ID":"fa32a7a6-c655-4d2f-a291-69fb51f9694a","Type":"ContainerStarted","Data":"6112f1e6246756679657c2b7544c4d53cce901cca7eedadc910eebf37b8de1de"} Jul 14 16:30:48.125515 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:48.125471 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-mw6cb" podStartSLOduration=1.125456689 podStartE2EDuration="1.125456689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:48.125197292 +0000 UTC m=+63.855570809" watchObservedRunningTime="2026-07-14 16:30:48.125456689 +0000 UTC m=+63.855830207" Jul 14 16:30:48.403730 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:48.402801 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:49.183506 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:49.183470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:49.286533 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:49.286492 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:50.438108 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.438069 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:50.619095 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.619068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:50.619283 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.619102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:50.619370 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.619349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:30:50.622351 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.622329 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4ml\" (UniqueName: \"kubernetes.io/projected/80bc4ef1-8cec-4e23-8136-3ab97fbae723-kube-api-access-rb4ml\") pod \"network-check-target-lczjs\" (UID: \"80bc4ef1-8cec-4e23-8136-3ab97fbae723\") " pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:50.624268 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.624219 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 16:30:50.624519 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.624502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 16:30:50.629695 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:50.629675 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 16:30:50.629886 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:50.629869 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs podName:c5149745-96d8-4185-aec6-3f0441bfe5a2 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:54.62984872 +0000 UTC m=+130.360222229 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs") pod "network-metrics-daemon-wvhtb" (UID: "c5149745-96d8-4185-aec6-3f0441bfe5a2") : secret "metrics-daemon-secret" not found Jul 14 16:30:50.632315 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.632284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c-original-pull-secret\") pod \"global-pull-secret-syncer-6b9q2\" (UID: \"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c\") " pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:50.648433 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.648396 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cr5gm\"" Jul 14 16:30:50.650504 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.650486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:50.650593 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.650508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b9q2" Jul 14 16:30:50.846823 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.846571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lczjs"] Jul 14 16:30:50.847468 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:50.847418 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bc4ef1_8cec_4e23_8136_3ab97fbae723.slice/crio-34d39bee710fc1ee178cb00dfe4ed4544a8e7c354b2dcbad9fad545819911d61 WatchSource:0}: Error finding container 34d39bee710fc1ee178cb00dfe4ed4544a8e7c354b2dcbad9fad545819911d61: Status 404 returned error can't find the container with id 34d39bee710fc1ee178cb00dfe4ed4544a8e7c354b2dcbad9fad545819911d61 Jul 14 16:30:50.869998 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:50.869944 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6b9q2"] Jul 14 16:30:50.886055 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:30:50.886031 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812e6e44_bd4f_4ca7_b4af_6892f3ecdb0c.slice/crio-fa75717f37d1248937bc2cddfdde37f28b18351cd2ae22d00782036b839c87e6 WatchSource:0}: Error finding container fa75717f37d1248937bc2cddfdde37f28b18351cd2ae22d00782036b839c87e6: Status 404 returned error can't find the container with id fa75717f37d1248937bc2cddfdde37f28b18351cd2ae22d00782036b839c87e6 Jul 14 16:30:51.116862 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:51.116825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6b9q2" event={"ID":"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c","Type":"ContainerStarted","Data":"fa75717f37d1248937bc2cddfdde37f28b18351cd2ae22d00782036b839c87e6"} Jul 14 16:30:51.118511 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:51.118484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lczjs" event={"ID":"80bc4ef1-8cec-4e23-8136-3ab97fbae723","Type":"ContainerStarted","Data":"ae01cd75a2ff93e091f713840742975503e5b78927ad014a109ba464d006ea39"} Jul 14 16:30:51.118647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:51.118529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lczjs" event={"ID":"80bc4ef1-8cec-4e23-8136-3ab97fbae723","Type":"ContainerStarted","Data":"34d39bee710fc1ee178cb00dfe4ed4544a8e7c354b2dcbad9fad545819911d61"} Jul 14 16:30:51.118647 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:51.118604 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:30:51.165476 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:51.165434 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lczjs" podStartSLOduration=67.165420494 podStartE2EDuration="1m7.165420494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:29:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:51.163131105 +0000 UTC m=+66.893504623" watchObservedRunningTime="2026-07-14 16:30:51.165420494 +0000 UTC m=+66.895794003" Jul 14 16:30:52.135192 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.135154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:52.135668 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.135283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:30:52.135668 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.135294 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 16:30:52.135668 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.135369 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:31:00.135346272 +0000 UTC m=+75.865719783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : configmap "kube-rbac-proxy" not found Jul 14 16:30:52.135668 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.135468 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:30:52.135668 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.135534 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:31:00.135517392 +0000 UTC m=+75.865890888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : secret "insights-runtime-extractor-tls" not found Jul 14 16:30:52.236287 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.236252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:30:52.236497 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.236314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:52.236497 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.236391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:30:52.236497 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.236426 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:52.236497 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.236497 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls podName:9c8f795f-c8cd-4f69-a876-e9f5a114b58d nodeName:}" failed. No retries permitted until 2026-07-14 16:31:08.236478586 +0000 UTC m=+83.966852103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-zfc5x" (UID: "9c8f795f-c8cd-4f69-a876-e9f5a114b58d") : secret "cluster-monitoring-operator-tls" not found Jul 14 16:30:52.236666 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.236539 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 16:30:52.236666 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.236573 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:31:08.23656369 +0000 UTC m=+83.966937199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : secret "router-metrics-certs-default" not found Jul 14 16:30:52.236666 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.236641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle podName:fa89f02a-149d-4402-9298-107d463f876f nodeName:}" failed. No retries permitted until 2026-07-14 16:31:08.236622035 +0000 UTC m=+83.966995531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle") pod "router-default-6f7c99c78d-j4xhp" (UID: "fa89f02a-149d-4402-9298-107d463f876f") : configmap references non-existent config key: service-ca.crt Jul 14 16:30:52.251479 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.251380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:52.357912 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.357874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:52.490920 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.490842 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:52.539056 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.539024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:30:52.539238 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.539073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:52.539238 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.539130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:30:52.539238 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.539137 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 16:30:52.539238 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.539199 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls podName:7818c2f5-46c7-4662-820b-051dff5254e4 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:24.53918094 +0000 UTC m=+100.269554458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls") pod "dns-default-94mms" (UID: "7818c2f5-46c7-4662-820b-051dff5254e4") : secret "dns-default-metrics-tls" not found Jul 14 16:30:52.539534 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.539240 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 16:30:52.539534 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.539252 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f8bf88964-chjzm: secret "image-registry-tls" not found Jul 14 16:30:52.539534 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:30:52.539295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls podName:d2a41f28-0d9c-4a77-887f-7ea27df19af6 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:24.539284301 +0000 UTC m=+100.269657797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls") pod "image-registry-f8bf88964-chjzm" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6") : secret "image-registry-tls" not found Jul 14 16:30:52.542199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.542170 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d77f00e-6a05-480b-8139-e797e83a5597-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zgcn6\" (UID: \"0d77f00e-6a05-480b-8139-e797e83a5597\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:52.585443 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.585388 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:52.623849 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.623823 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-snzcb\"" Jul 14 16:30:52.630592 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.630567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" Jul 14 16:30:52.686815 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.686735 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:52.799605 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.799553 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:52.811101 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.811025 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6"] Jul 14 16:30:52.917436 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:52.917339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:53.027478 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:53.027371 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:53.128631 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:53.128588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" event={"ID":"0d77f00e-6a05-480b-8139-e797e83a5597","Type":"ContainerStarted","Data":"69d1ad3a4893d2ea2b19f6b5d5d0b7681b3f4f8fb75b724771bad5caeb59ea02"} Jul 14 16:30:53.165084 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:53.165053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:54.526889 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:54.526843 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:54.602390 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:54.602356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:54.697799 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:54.697719 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:56.752644 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:56.752609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:56.854874 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:56.854844 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:56.936929 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:56.936894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:57.089924 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:57.089812 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:57.143921 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:57.143893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6b9q2" event={"ID":"812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c","Type":"ContainerStarted","Data":"ba6f20fb008f0297d45cacadec0dfd74c462b0fae3ccf86dcb83172cbff8638f"} Jul 14 16:30:57.474876 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:57.474781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:57.604541 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:57.604503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:57.704789 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:57.704753 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:57.981516 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:57.981466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:58.120981 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:58.120944 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:58.192573 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:58.192540 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:58.899987 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:58.899950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:59.079274 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:59.079249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:59.154580 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:59.154514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" event={"ID":"0d77f00e-6a05-480b-8139-e797e83a5597","Type":"ContainerStarted","Data":"b8042c1577f8c9e4714bf1e171e903207a8e6a0b44f52334300f64e0629fafd8"} Jul 14 16:30:59.358730 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:59.358688 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:30:59.478172 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:30:59.478081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:00.158840 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.158808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" event={"ID":"0d77f00e-6a05-480b-8139-e797e83a5597","Type":"ContainerStarted","Data":"075a2708a4a8336b2fc676b634d3c630dcbc457284ffab13503f740373cc1079"} Jul 14 16:31:00.182276 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.182232 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6b9q2" podStartSLOduration=69.999267225 podStartE2EDuration="1m15.182217496s" totalImagesPullingTime="5.182950271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:57.176073144 +0000 UTC m=+72.906446662" watchObservedRunningTime="2026-07-14 16:31:00.182217496 +0000 UTC m=+75.912591014" Jul 14 16:31:00.182557 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.182535 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zgcn6" podStartSLOduration=18.025264691 podStartE2EDuration="24.182529599s" totalImagesPullingTime="6.157264908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:00.181072585 +0000 UTC m=+75.911446115" watchObservedRunningTime="2026-07-14 16:31:00.182529599 +0000 UTC m=+75.912903117" Jul 14 16:31:00.207027 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.207004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:31:00.207127 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.207073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:31:00.207198 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:31:00.207177 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 16:31:00.207261 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:31:00.207252 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls podName:643fe84c-dff9-4186-b603-636ba30072ed nodeName:}" failed. No retries permitted until 2026-07-14 16:31:16.207233708 +0000 UTC m=+91.937607206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkzns" (UID: "643fe84c-dff9-4186-b603-636ba30072ed") : secret "insights-runtime-extractor-tls" not found Jul 14 16:31:00.207508 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.207490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/643fe84c-dff9-4186-b603-636ba30072ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:31:00.282552 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.282520 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:00.407078 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.407051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:00.721491 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.721460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:00.829902 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.829872 2576 scope.go:117] "RemoveContainer" containerID="6bab12af34238985d54fe27c7ed956daa49b8e75fb9dfdf12c8d2ffc4e1ee7c7" Jul 14 16:31:00.913503 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:00.913475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:01.097576 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:01.097543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:01.164438 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:01.164392 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:31:01.164893 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:01.164530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xgcjz" event={"ID":"a52d3a93-6f57-49bc-8975-79ef0918907a","Type":"ContainerStarted","Data":"2cae754c879cd6c0b03e7fb7a41fff6a3e9b06a16583865546efc96476e040e5"} Jul 14 16:31:01.164954 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:01.164934 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:31:01.239201 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:01.239173 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-xgcjz" Jul 14 16:31:01.259976 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:01.259918 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-xgcjz" podStartSLOduration=19.187805234 podStartE2EDuration="25.259897668s" totalImagesPullingTime="6.072092434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:01.188565971 +0000 UTC m=+76.918939489" watchObservedRunningTime="2026-07-14 16:31:01.259897668 +0000 UTC m=+76.990271183" Jul 14 16:31:02.127780 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:02.127745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:02.196721 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:02.196689 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:02.304800 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:02.304763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:02.409859 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:02.409781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:02.710699 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:02.710621 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:02.916219 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:02.916188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:03.152577 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:03.152541 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:03.253551 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:03.253514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:03.351638 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:03.351608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:03.806830 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:03.806794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:03.880393 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:03.880352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:06.752949 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:06.752818 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:06.853900 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:06.853860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:08.275782 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.275739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:31:08.276286 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.275805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:08.276286 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.275869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:08.276451 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.276430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa89f02a-149d-4402-9298-107d463f876f-service-ca-bundle\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:08.278316 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.278291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa89f02a-149d-4402-9298-107d463f876f-metrics-certs\") pod \"router-default-6f7c99c78d-j4xhp\" (UID: \"fa89f02a-149d-4402-9298-107d463f876f\") " pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:08.278426 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.278292 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c8f795f-c8cd-4f69-a876-e9f5a114b58d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-zfc5x\" (UID: \"9c8f795f-c8cd-4f69-a876-e9f5a114b58d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:31:08.285292 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.285246 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4mct4\"" Jul 14 16:31:08.293039 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.293005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:08.431459 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.431421 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f7c99c78d-j4xhp"] Jul 14 16:31:08.434787 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:08.434760 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa89f02a_149d_4402_9298_107d463f876f.slice/crio-721b50d6fbaeef3907740a5b20774d689e0e5fa11972cb768f6b098a40112cb3 WatchSource:0}: Error finding container 721b50d6fbaeef3907740a5b20774d689e0e5fa11972cb768f6b098a40112cb3: Status 404 returned error can't find the container with id 721b50d6fbaeef3907740a5b20774d689e0e5fa11972cb768f6b098a40112cb3 Jul 14 16:31:08.544477 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.544360 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:08.547926 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.547905 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gsk2t\"" Jul 14 16:31:08.555607 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.555586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" Jul 14 16:31:08.609087 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.607271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:08.708753 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:08.708715 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x"] Jul 14 16:31:08.711556 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:08.711524 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8f795f_c8cd_4f69_a876_e9f5a114b58d.slice/crio-9c8f9244259b3737004c9b5ee96304a406961d95af114ab4abb353aa149fadfe WatchSource:0}: Error finding container 9c8f9244259b3737004c9b5ee96304a406961d95af114ab4abb353aa149fadfe: Status 404 returned error can't find the container with id 9c8f9244259b3737004c9b5ee96304a406961d95af114ab4abb353aa149fadfe Jul 14 16:31:09.192798 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:09.192758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" event={"ID":"fa89f02a-149d-4402-9298-107d463f876f","Type":"ContainerStarted","Data":"0a5c2ba8d0d1a9fd71b7b202ae6152b63d38731fb66e8ff9f41109d7c4cd4711"} Jul 14 16:31:09.193104 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:09.192818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" event={"ID":"fa89f02a-149d-4402-9298-107d463f876f","Type":"ContainerStarted","Data":"721b50d6fbaeef3907740a5b20774d689e0e5fa11972cb768f6b098a40112cb3"} Jul 14 16:31:09.193950 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:09.193919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" event={"ID":"9c8f795f-c8cd-4f69-a876-e9f5a114b58d","Type":"ContainerStarted","Data":"9c8f9244259b3737004c9b5ee96304a406961d95af114ab4abb353aa149fadfe"} Jul 14 16:31:09.221765 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:09.221707 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" podStartSLOduration=33.221688854 podStartE2EDuration="33.221688854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:09.221169606 +0000 UTC m=+84.951543161" watchObservedRunningTime="2026-07-14 16:31:09.221688854 +0000 UTC m=+84.952062371" Jul 14 16:31:09.294141 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:09.294095 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:09.296664 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:09.296638 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:10.157502 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:10.157458 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:10.197868 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:10.197837 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:10.199249 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:10.199221 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f7c99c78d-j4xhp" Jul 14 16:31:10.298448 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:10.298396 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:10.496321 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:10.496279 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:11.203110 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.203073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" event={"ID":"9c8f795f-c8cd-4f69-a876-e9f5a114b58d","Type":"ContainerStarted","Data":"073c238f3d9bdc759e56e7041419ddaa7037fac252faaa64ba27bbb21cabfa22"} Jul 14 16:31:11.222555 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.222501 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-zfc5x" podStartSLOduration=32.833642704 podStartE2EDuration="35.222484283s" totalImagesPullingTime="2.388841579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:11.221763051 +0000 UTC m=+86.952136571" watchObservedRunningTime="2026-07-14 16:31:11.222484283 +0000 UTC m=+86.952857801" Jul 14 16:31:11.328591 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.328544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:11.429458 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.429344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:11.549766 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.549723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:11.715459 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.715351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:11.868483 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:11.868439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:12.545875 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:12.545839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:12.652060 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:12.652020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:12.770773 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:12.770735 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:12.996626 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:12.996595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:13.087516 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:13.087483 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:16.246456 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.246392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:31:16.248841 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.248812 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/643fe84c-dff9-4186-b603-636ba30072ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkzns\" (UID: \"643fe84c-dff9-4186-b603-636ba30072ed\") " pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:31:16.527844 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.527761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbmcg\"" Jul 14 16:31:16.534661 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.534634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hkzns" Jul 14 16:31:16.698606 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.698562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hkzns"] Jul 14 16:31:16.701805 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:16.701772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643fe84c_dff9_4186_b603_636ba30072ed.slice/crio-5b3690a04a166782e0114d921ec0f16eb81b9145644417e98ebde48af86bce11 WatchSource:0}: Error finding container 5b3690a04a166782e0114d921ec0f16eb81b9145644417e98ebde48af86bce11: Status 404 returned error can't find the container with id 5b3690a04a166782e0114d921ec0f16eb81b9145644417e98ebde48af86bce11 Jul 14 16:31:16.739978 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.739942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:16.826212 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.826115 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:16.924040 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.923998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:16.996957 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:16.996921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:17.227148 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:17.227049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkzns" event={"ID":"643fe84c-dff9-4186-b603-636ba30072ed","Type":"ContainerStarted","Data":"5b3690a04a166782e0114d921ec0f16eb81b9145644417e98ebde48af86bce11"} Jul 14 16:31:17.513453 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:17.513305 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:17.916545 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:17.916438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:18.041950 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:18.041913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:18.558825 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:18.558787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:18.632342 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:18.632299 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:19.689343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:19.689299 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:22.127060 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:22.127028 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lczjs" Jul 14 16:31:22.399199 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:22.399085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:22.502711 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:22.502669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:22.583988 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:22.583949 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:23.251568 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:23.251532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkzns" event={"ID":"643fe84c-dff9-4186-b603-636ba30072ed","Type":"ContainerStarted","Data":"8cb10d9742baad4c93ee11b72b82fbf505914bfe56f9318e58487ae0f5621267"} Jul 14 16:31:23.251953 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:23.251591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkzns" event={"ID":"643fe84c-dff9-4186-b603-636ba30072ed","Type":"ContainerStarted","Data":"c80d15870bc0d5be035d0549ba7ced3f9dcd77e40257a343304b9aee1bb058fc"} Jul 14 16:31:24.624597 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.624547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:31:24.625060 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.624758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:24.627239 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.627197 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7818c2f5-46c7-4662-820b-051dff5254e4-metrics-tls\") pod \"dns-default-94mms\" (UID: \"7818c2f5-46c7-4662-820b-051dff5254e4\") " pod="openshift-dns/dns-default-94mms" Jul 14 16:31:24.627370 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.627334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"image-registry-f8bf88964-chjzm\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:24.850396 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.850360 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l67zw\"" Jul 14 16:31:24.857742 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.857572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:24.926472 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.926166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jq9rg\"" Jul 14 16:31:24.934655 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.934535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94mms" Jul 14 16:31:24.946487 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:24.946454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.106373 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.106317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.243113 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.242917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.343115 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.342880 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-78mvp"] Jul 14 16:31:25.352547 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.352504 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.357871 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.357842 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 16:31:25.357871 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.357856 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 16:31:25.358104 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.357934 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 16:31:25.358104 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.358028 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 16:31:25.363965 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.363897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-47qjp\"" Jul 14 16:31:25.369193 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.369159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-78mvp"] Jul 14 16:31:25.416991 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.416953 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.421559 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.421525 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6dkdq"] Jul 14 16:31:25.424348 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.424323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.427538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.427511 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 16:31:25.428258 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.428115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 16:31:25.428258 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.428165 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmsg7\"" Jul 14 16:31:25.428689 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.428498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 16:31:25.430971 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.430651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.430971 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.430701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.430971 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.430729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.430971 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.430768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.430971 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.430799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.430971 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.430869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trk4f\" (UniqueName: \"kubernetes.io/projected/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-api-access-trk4f\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.531692 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-wtmp\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.531836 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.531836 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.531836 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9007891d-d1d0-4497-b081-c103a001d8b0-metrics-client-ca\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.531985 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.531985 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzss\" (UniqueName: \"kubernetes.io/projected/9007891d-d1d0-4497-b081-c103a001d8b0-kube-api-access-chzss\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.531985 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.532202 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.531987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trk4f\" (UniqueName: \"kubernetes.io/projected/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-api-access-trk4f\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.532202 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.532033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-root\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.532202 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.532064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.532202 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.532135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-sys\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.532390 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.532252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.534937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.533155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.534937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.533229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.534937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.533512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-tls\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.534937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.533590 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.534937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.533595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-textfile\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.534937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.534329 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.537040 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.536982 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.544741 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.544675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.553125 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.553081 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trk4f\" (UniqueName: \"kubernetes.io/projected/1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d-kube-api-access-trk4f\") pod \"kube-state-metrics-785778ff74-78mvp\" (UID: \"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.554707 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.554611 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.637687 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzss\" (UniqueName: \"kubernetes.io/projected/9007891d-d1d0-4497-b081-c103a001d8b0-kube-api-access-chzss\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-root\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-sys\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-tls\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-textfile\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-wtmp\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.637962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9007891d-d1d0-4497-b081-c103a001d8b0-metrics-client-ca\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.638551 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.638264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-root\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.638694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9007891d-d1d0-4497-b081-c103a001d8b0-metrics-client-ca\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.638760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-sys\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.638811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:31:25.638849 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:31:25.638907 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-tls podName:9007891d-d1d0-4497-b081-c103a001d8b0 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:26.138887307 +0000 UTC m=+101.869260819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-tls") pod "node-exporter-6dkdq" (UID: "9007891d-d1d0-4497-b081-c103a001d8b0") : secret "node-exporter-tls" not found Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.639230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-textfile\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.641784 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.639370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-wtmp\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.642252 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.641980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.654743 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.654637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzss\" (UniqueName: \"kubernetes.io/projected/9007891d-d1d0-4497-b081-c103a001d8b0-kube-api-access-chzss\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:25.667675 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.667357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" Jul 14 16:31:25.680336 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.680301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.696578 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.695889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f8bf88964-chjzm"] Jul 14 16:31:25.700304 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:25.700273 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a41f28_0d9c_4a77_887f_7ea27df19af6.slice/crio-5fe39900465a8792790963946d7bfdf8c5ad1dfa27f4bacb0f108078f6409b34 WatchSource:0}: Error finding container 5fe39900465a8792790963946d7bfdf8c5ad1dfa27f4bacb0f108078f6409b34: Status 404 returned error can't find the container with id 5fe39900465a8792790963946d7bfdf8c5ad1dfa27f4bacb0f108078f6409b34 Jul 14 16:31:25.707830 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.707517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-94mms"] Jul 14 16:31:25.809327 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.809290 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:25.850118 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.850082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-78mvp"] Jul 14 16:31:25.853695 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:25.853663 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7b6e9c_2c76_46c9_9ddd_0b4e52d25d3d.slice/crio-0a170c99db7a3a2c8609b78beef488c98f68eb09d5a428a819d46adb31a95e06 WatchSource:0}: Error finding container 0a170c99db7a3a2c8609b78beef488c98f68eb09d5a428a819d46adb31a95e06: Status 404 returned error can't find the container with id 0a170c99db7a3a2c8609b78beef488c98f68eb09d5a428a819d46adb31a95e06 Jul 14 16:31:25.968598 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:25.968559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:26.120210 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.120111 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:26.143892 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.143852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-tls\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:26.146546 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.146505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9007891d-d1d0-4497-b081-c103a001d8b0-node-exporter-tls\") pod \"node-exporter-6dkdq\" (UID: \"9007891d-d1d0-4497-b081-c103a001d8b0\") " pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:26.264632 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.264596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" event={"ID":"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d","Type":"ContainerStarted","Data":"0a170c99db7a3a2c8609b78beef488c98f68eb09d5a428a819d46adb31a95e06"} Jul 14 16:31:26.266179 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.266153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" event={"ID":"d2a41f28-0d9c-4a77-887f-7ea27df19af6","Type":"ContainerStarted","Data":"8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d"} Jul 14 16:31:26.266333 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.266197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" event={"ID":"d2a41f28-0d9c-4a77-887f-7ea27df19af6","Type":"ContainerStarted","Data":"5fe39900465a8792790963946d7bfdf8c5ad1dfa27f4bacb0f108078f6409b34"} Jul 14 16:31:26.266333 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.266264 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:26.268440 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.268414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkzns" event={"ID":"643fe84c-dff9-4186-b603-636ba30072ed","Type":"ContainerStarted","Data":"3988c25a867dc483355f848b90c6d7911047ce13ffa2741a73a1d052c13eb280"} Jul 14 16:31:26.269625 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.269602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94mms" event={"ID":"7818c2f5-46c7-4662-820b-051dff5254e4","Type":"ContainerStarted","Data":"10da03c63b78655a2de43a5ae46a30ce9c22d18a6b05b3a90c25ad581bbd6fb7"} Jul 14 16:31:26.327021 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.326969 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" podStartSLOduration=101.326952061 podStartE2EDuration="1m41.326952061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:26.32616665 +0000 UTC m=+102.056540169" watchObservedRunningTime="2026-07-14 16:31:26.326952061 +0000 UTC m=+102.057325556" Jul 14 16:31:26.338758 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.338727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6dkdq" Jul 14 16:31:26.349971 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:26.349936 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9007891d_d1d0_4497_b081_c103a001d8b0.slice/crio-1900b1908b48f99539dabb4cef54300d0a757fda9a6ac2a9aebc158f171c18b2 WatchSource:0}: Error finding container 1900b1908b48f99539dabb4cef54300d0a757fda9a6ac2a9aebc158f171c18b2: Status 404 returned error can't find the container with id 1900b1908b48f99539dabb4cef54300d0a757fda9a6ac2a9aebc158f171c18b2 Jul 14 16:31:26.357720 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.357657 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hkzns" podStartSLOduration=33.648220562 podStartE2EDuration="42.35762411s" totalImagesPullingTime="8.709403548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:30:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:26.357579093 +0000 UTC m=+102.087952612" watchObservedRunningTime="2026-07-14 16:31:26.35762411 +0000 UTC m=+102.087997628" Jul 14 16:31:26.429937 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.429842 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:26.620913 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.620873 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 16:31:26.624244 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.624217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.632909 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.632862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:26.635674 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.635647 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 16:31:26.635674 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.635672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 16:31:26.635892 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.635818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 16:31:26.635962 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.635945 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 16:31:26.636029 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.635996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 16:31:26.636932 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.636915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 16:31:26.637029 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.636928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 16:31:26.637253 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.637238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lw72k\"" Jul 14 16:31:26.637331 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.637243 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 16:31:26.637331 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.637243 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 16:31:26.748792 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.748751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.748812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-config-volume\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.748871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.748911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.748991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9080d7f7-51f4-4281-b2c1-b7e9865af588-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-web-config\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pww7l\" (UniqueName: \"kubernetes.io/projected/9080d7f7-51f4-4281-b2c1-b7e9865af588-kube-api-access-pww7l\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9080d7f7-51f4-4281-b2c1-b7e9865af588-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749318 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749753 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9080d7f7-51f4-4281-b2c1-b7e9865af588-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749753 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9080d7f7-51f4-4281-b2c1-b7e9865af588-config-out\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.749753 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.749384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9080d7f7-51f4-4281-b2c1-b7e9865af588-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.758702 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.758663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 16:31:26.803925 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.803840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:26.850995 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.850961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9080d7f7-51f4-4281-b2c1-b7e9865af588-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9080d7f7-51f4-4281-b2c1-b7e9865af588-config-out\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9080d7f7-51f4-4281-b2c1-b7e9865af588-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-config-volume\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9080d7f7-51f4-4281-b2c1-b7e9865af588-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851624 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-web-config\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851624 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pww7l\" (UniqueName: \"kubernetes.io/projected/9080d7f7-51f4-4281-b2c1-b7e9865af588-kube-api-access-pww7l\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851624 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9080d7f7-51f4-4281-b2c1-b7e9865af588-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.851624 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.851289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.852953 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.852918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9080d7f7-51f4-4281-b2c1-b7e9865af588-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.854419 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.854072 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9080d7f7-51f4-4281-b2c1-b7e9865af588-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.854419 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.854168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9080d7f7-51f4-4281-b2c1-b7e9865af588-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.860354 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.859942 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-web-config\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.860354 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.860291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.861131 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.860889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.861131 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.861082 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9080d7f7-51f4-4281-b2c1-b7e9865af588-config-out\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.861422 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.861358 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9080d7f7-51f4-4281-b2c1-b7e9865af588-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.861568 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.861513 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-config-volume\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.862491 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.862429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.862581 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.862394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.863745 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.863698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9080d7f7-51f4-4281-b2c1-b7e9865af588-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.867241 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.867181 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pww7l\" (UniqueName: \"kubernetes.io/projected/9080d7f7-51f4-4281-b2c1-b7e9865af588-kube-api-access-pww7l\") pod \"alertmanager-main-0\" (UID: \"9080d7f7-51f4-4281-b2c1-b7e9865af588\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:26.951190 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:26.950925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 16:31:27.184162 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:27.184047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 16:31:27.274983 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:27.274832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dkdq" event={"ID":"9007891d-d1d0-4497-b081-c103a001d8b0","Type":"ContainerStarted","Data":"1900b1908b48f99539dabb4cef54300d0a757fda9a6ac2a9aebc158f171c18b2"} Jul 14 16:31:27.385693 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:27.385655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9080d7f7_51f4_4281_b2c1_b7e9865af588.slice/crio-899c4feca91ad86b907d4a1f36f107cefee5d997346a05330b29023b1c9fac1f WatchSource:0}: Error finding container 899c4feca91ad86b907d4a1f36f107cefee5d997346a05330b29023b1c9fac1f: Status 404 returned error can't find the container with id 899c4feca91ad86b907d4a1f36f107cefee5d997346a05330b29023b1c9fac1f Jul 14 16:31:28.282286 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:28.282246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94mms" event={"ID":"7818c2f5-46c7-4662-820b-051dff5254e4","Type":"ContainerStarted","Data":"3ff6041b7dfc9616b21298b989efca0c1bd07acca6ec449d0cee2d06212738e6"} Jul 14 16:31:28.284470 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:28.284434 2576 generic.go:356] "Generic (PLEG): container finished" podID="9007891d-d1d0-4497-b081-c103a001d8b0" containerID="aff2abf4c0eae4bf785bb53ef10b9dd4c370f8dddce4f868b7a203a77bb92a4f" exitCode=0 Jul 14 16:31:28.284634 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:28.284525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dkdq" event={"ID":"9007891d-d1d0-4497-b081-c103a001d8b0","Type":"ContainerDied","Data":"aff2abf4c0eae4bf785bb53ef10b9dd4c370f8dddce4f868b7a203a77bb92a4f"} Jul 14 16:31:28.287883 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:28.287846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"899c4feca91ad86b907d4a1f36f107cefee5d997346a05330b29023b1c9fac1f"} Jul 14 16:31:28.623630 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:28.623431 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:28.901996 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:28.901906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:29.294011 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.293983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94mms" event={"ID":"7818c2f5-46c7-4662-820b-051dff5254e4","Type":"ContainerStarted","Data":"03cd6fbfe5397067caaa0a217e7c5465da4c6c5597a488e83ad22e07b0154512"} Jul 14 16:31:29.294446 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.294122 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-94mms" Jul 14 16:31:29.296642 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.296611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dkdq" event={"ID":"9007891d-d1d0-4497-b081-c103a001d8b0","Type":"ContainerStarted","Data":"209068e6a3e526181e8afb41074e26e85668b167fb15bb5cbcd0575141868789"} Jul 14 16:31:29.296771 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.296673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6dkdq" event={"ID":"9007891d-d1d0-4497-b081-c103a001d8b0","Type":"ContainerStarted","Data":"243a6365532d58950d343518ee037139a62064cb0d5cedcb1d854678bdda6d00"} Jul 14 16:31:29.336508 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.336454 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-94mms" podStartSLOduration=66.945105851 podStartE2EDuration="1m9.336392592s" totalImagesPullingTime="2.391286741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:29.336194949 +0000 UTC m=+105.066568467" watchObservedRunningTime="2026-07-14 16:31:29.336392592 +0000 UTC m=+105.066766110" Jul 14 16:31:29.401081 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.401054 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:29.607818 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.607785 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:29.820580 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:29.820480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:30.110660 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.110557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:30.238395 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.238340 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6dkdq" podStartSLOduration=4.095300326 podStartE2EDuration="5.238320213s" totalImagesPullingTime="1.058466367s" totalInitContainerRuntime="84.55352ms" isStatefulPod=true podCreationTimestamp="2026-07-14 16:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:29.387194491 +0000 UTC m=+105.117568010" watchObservedRunningTime="2026-07-14 16:31:30.238320213 +0000 UTC m=+105.968693797" Jul 14 16:31:30.238746 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.238728 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2"] Jul 14 16:31:30.272544 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.272508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.281372 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.281340 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 16:31:30.281613 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.281486 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4mdd4\"" Jul 14 16:31:30.286735 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.286705 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2"] Jul 14 16:31:30.302459 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.302397 2576 generic.go:356] "Generic (PLEG): container finished" podID="9080d7f7-51f4-4281-b2c1-b7e9865af588" containerID="b30ee6a047bf5230049c61105338e2ecf0768542e5bb5242ee12b12d145be85a" exitCode=0 Jul 14 16:31:30.302459 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.302439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerDied","Data":"b30ee6a047bf5230049c61105338e2ecf0768542e5bb5242ee12b12d145be85a"} Jul 14 16:31:30.305374 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.305334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" event={"ID":"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d","Type":"ContainerStarted","Data":"a1ddcf3185c6a75b4efa04ca7940e568a59f36d60c024522c25f271177c6e18c"} Jul 14 16:31:30.305515 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.305418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" event={"ID":"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d","Type":"ContainerStarted","Data":"85a73cc3b849cf28d08d1834543de2ec8e0437ced96902b2e7058e39d94db9dc"} Jul 14 16:31:30.305515 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.305451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" event={"ID":"1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d","Type":"ContainerStarted","Data":"145af495bf93bb853624f781238136458beac8a23f6d51f569750ea3204addd9"} Jul 14 16:31:30.376872 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.376744 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-78mvp" podStartSLOduration=1.955909554 podStartE2EDuration="5.376726225s" totalImagesPullingTime="3.420816671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:30.37585767 +0000 UTC m=+106.106231188" watchObservedRunningTime="2026-07-14 16:31:30.376726225 +0000 UTC m=+106.107099787" Jul 14 16:31:30.387922 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.387880 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:30.390944 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.390912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59ee894a-3077-4381-b368-291e9500e490-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qwtg2\" (UID: \"59ee894a-3077-4381-b368-291e9500e490\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.391774 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.391742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc5l5\" (UniqueName: \"kubernetes.io/projected/59ee894a-3077-4381-b368-291e9500e490-kube-api-access-bc5l5\") pod \"monitoring-plugin-5f68df7f58-qwtg2\" (UID: \"59ee894a-3077-4381-b368-291e9500e490\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.492238 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.492196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc5l5\" (UniqueName: \"kubernetes.io/projected/59ee894a-3077-4381-b368-291e9500e490-kube-api-access-bc5l5\") pod \"monitoring-plugin-5f68df7f58-qwtg2\" (UID: \"59ee894a-3077-4381-b368-291e9500e490\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.492238 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.492236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59ee894a-3077-4381-b368-291e9500e490-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qwtg2\" (UID: \"59ee894a-3077-4381-b368-291e9500e490\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.494862 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.494834 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59ee894a-3077-4381-b368-291e9500e490-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qwtg2\" (UID: \"59ee894a-3077-4381-b368-291e9500e490\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.542686 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.542584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc5l5\" (UniqueName: \"kubernetes.io/projected/59ee894a-3077-4381-b368-291e9500e490-kube-api-access-bc5l5\") pod \"monitoring-plugin-5f68df7f58-qwtg2\" (UID: \"59ee894a-3077-4381-b368-291e9500e490\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.589761 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.589685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:30.634640 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.634555 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:30.753927 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:30.753893 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2"] Jul 14 16:31:30.757459 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:30.757424 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ee894a_3077_4381_b368_291e9500e490.slice/crio-f62384c4a31b4e7d874d062842822a9fa759a3e06355a15e715d4dea5f81c614 WatchSource:0}: Error finding container f62384c4a31b4e7d874d062842822a9fa759a3e06355a15e715d4dea5f81c614: Status 404 returned error can't find the container with id f62384c4a31b4e7d874d062842822a9fa759a3e06355a15e715d4dea5f81c614 Jul 14 16:31:31.310941 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:31.310903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" event={"ID":"59ee894a-3077-4381-b368-291e9500e490","Type":"ContainerStarted","Data":"f62384c4a31b4e7d874d062842822a9fa759a3e06355a15e715d4dea5f81c614"} Jul 14 16:31:32.078249 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:32.078197 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:32.883055 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:32.883022 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f8bf88964-chjzm"] Jul 14 16:31:33.027044 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.026998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:33.239562 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.239523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:33.327393 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.327351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"8a0a5ed79d92a702a8e75e5e95eee0f0e4da7b59524d2b488ab97bce6d51a0d9"} Jul 14 16:31:33.327600 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.327494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"f72c7673f6817f76a408314562463adface696eb18ce020f070f9387c937c5ea"} Jul 14 16:31:33.327600 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.327539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"08039711870a1d850edf4deb303eb246f90661db8991fcd77682d6839fc15557"} Jul 14 16:31:33.327600 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.327576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"a819c905595037fc6c38b5dc553d330dfcf8402086a69eb36cee407241ad83a0"} Jul 14 16:31:33.327722 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.327614 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"7e708da4586376752d48cd8647f6088a89f93f6a515874742e8eec495f579d69"} Jul 14 16:31:33.329176 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.329145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" event={"ID":"59ee894a-3077-4381-b368-291e9500e490","Type":"ContainerStarted","Data":"951c2a26bf16d12244738197d96bc24d58743e22125666c92a60fcf3f06ff7ba"} Jul 14 16:31:33.329328 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.329283 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:33.334530 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.334499 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" Jul 14 16:31:33.364472 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:33.364378 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qwtg2" podStartSLOduration=1.465852444 podStartE2EDuration="3.364360595s" totalImagesPullingTime="1.898508151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:33.361516439 +0000 UTC m=+109.091889962" watchObservedRunningTime="2026-07-14 16:31:33.364360595 +0000 UTC m=+109.094734112" Jul 14 16:31:34.337443 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:34.337385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9080d7f7-51f4-4281-b2c1-b7e9865af588","Type":"ContainerStarted","Data":"5b25ac9a9c278e4e8014b74942b39b19ecc292ccc3122e4f3d3d24ec46eb2194"} Jul 14 16:31:34.502823 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:34.502759 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.433480095 podStartE2EDuration="8.502739501s" totalImagesPullingTime="5.042790381s" totalInitContainerRuntime="26.469025ms" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:34.500682034 +0000 UTC m=+110.231055551" watchObservedRunningTime="2026-07-14 16:31:34.502739501 +0000 UTC m=+110.233113020" Jul 14 16:31:39.309252 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:39.309216 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-94mms" Jul 14 16:31:40.496067 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:40.496028 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:40.679242 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:40.679204 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:42.889266 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:42.889235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:43.414832 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:43.414783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:43.560283 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:43.560244 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:48.548893 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:48.548858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:48.662969 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:48.662917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:51.242580 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:51.242543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:51.424175 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:51.424128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:53.550501 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:53.550463 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:53.654642 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:53.654605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:53.723916 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:53.723875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:54.715295 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:54.715248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:31:54.717772 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:54.717745 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5149745-96d8-4185-aec6-3f0441bfe5a2-metrics-certs\") pod \"network-metrics-daemon-wvhtb\" (UID: \"c5149745-96d8-4185-aec6-3f0441bfe5a2\") " pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:31:54.850577 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:54.850543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2hfc\"" Jul 14 16:31:54.856454 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:54.856424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvhtb" Jul 14 16:31:55.150994 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:55.150957 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wvhtb"] Jul 14 16:31:55.153950 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:31:55.153921 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5149745_96d8_4185_aec6_3f0441bfe5a2.slice/crio-74842cc0a55e8ccfee0520121fd3594dc74114fbbfed02b9c351151390b59e38 WatchSource:0}: Error finding container 74842cc0a55e8ccfee0520121fd3594dc74114fbbfed02b9c351151390b59e38: Status 404 returned error can't find the container with id 74842cc0a55e8ccfee0520121fd3594dc74114fbbfed02b9c351151390b59e38 Jul 14 16:31:55.422990 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:55.422906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wvhtb" event={"ID":"c5149745-96d8-4185-aec6-3f0441bfe5a2","Type":"ContainerStarted","Data":"74842cc0a55e8ccfee0520121fd3594dc74114fbbfed02b9c351151390b59e38"} Jul 14 16:31:57.436296 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:57.436254 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wvhtb" event={"ID":"c5149745-96d8-4185-aec6-3f0441bfe5a2","Type":"ContainerStarted","Data":"93b026d4197597a144abf890e866353276433fd2204ad8b985a1ff36749bdbd2"} Jul 14 16:31:57.436833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:57.436324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wvhtb" event={"ID":"c5149745-96d8-4185-aec6-3f0441bfe5a2","Type":"ContainerStarted","Data":"d3a278921e2614908ecc9f54d309da00c56c3598ec646e393d58d9990ac5ec85"} Jul 14 16:31:57.462587 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:57.462524 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wvhtb" podStartSLOduration=131.258462386 podStartE2EDuration="2m12.462501236s" totalImagesPullingTime="1.20403885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:57.461027597 +0000 UTC m=+133.191401131" watchObservedRunningTime="2026-07-14 16:31:57.462501236 +0000 UTC m=+133.192874758" Jul 14 16:31:57.582500 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:57.582463 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:57.907905 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:57.907861 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" podUID="d2a41f28-0d9c-4a77-887f-7ea27df19af6" containerName="registry" containerID="cri-o://8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d" gracePeriod=30 Jul 14 16:31:58.157036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.157004 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:58.345736 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-certificates\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345736 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345747 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2vfg\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-kube-api-access-f2vfg\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-trusted-ca\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345839 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2a41f28-0d9c-4a77-887f-7ea27df19af6-ca-trust-extracted\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345863 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-image-registry-private-configuration\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345927 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-bound-sa-token\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.345992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.345967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-installation-pull-secrets\") pod \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\" (UID: \"d2a41f28-0d9c-4a77-887f-7ea27df19af6\") " Jul 14 16:31:58.346321 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.346167 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:58.346393 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.346264 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 16:31:58.348618 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.348573 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-kube-api-access-f2vfg" (OuterVolumeSpecName: "kube-api-access-f2vfg") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "kube-api-access-f2vfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:58.348781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.348622 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:58.348781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.348647 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 16:31:58.348781 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.348754 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:31:58.348952 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.348819 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 16:31:58.354863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.354827 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a41f28-0d9c-4a77-887f-7ea27df19af6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d2a41f28-0d9c-4a77-887f-7ea27df19af6" (UID: "d2a41f28-0d9c-4a77-887f-7ea27df19af6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 16:31:58.442055 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.442019 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2a41f28-0d9c-4a77-887f-7ea27df19af6" containerID="8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d" exitCode=0 Jul 14 16:31:58.442541 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.442062 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" Jul 14 16:31:58.442541 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.442108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" event={"ID":"d2a41f28-0d9c-4a77-887f-7ea27df19af6","Type":"ContainerDied","Data":"8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d"} Jul 14 16:31:58.442541 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.442163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f8bf88964-chjzm" event={"ID":"d2a41f28-0d9c-4a77-887f-7ea27df19af6","Type":"ContainerDied","Data":"5fe39900465a8792790963946d7bfdf8c5ad1dfa27f4bacb0f108078f6409b34"} Jul 14 16:31:58.442541 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.442183 2576 scope.go:117] "RemoveContainer" containerID="8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d" Jul 14 16:31:58.447548 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447514 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2a41f28-0d9c-4a77-887f-7ea27df19af6-ca-trust-extracted\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447548 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447546 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-image-registry-private-configuration\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447769 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447563 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-bound-sa-token\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447769 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447576 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2a41f28-0d9c-4a77-887f-7ea27df19af6-installation-pull-secrets\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447769 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447589 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-certificates\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447769 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447602 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2vfg\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-kube-api-access-f2vfg\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447769 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447611 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2a41f28-0d9c-4a77-887f-7ea27df19af6-trusted-ca\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.447769 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.447619 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2a41f28-0d9c-4a77-887f-7ea27df19af6-registry-tls\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 16:31:58.451514 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.451494 2576 scope.go:117] "RemoveContainer" containerID="8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d" Jul 14 16:31:58.451824 ip-10-0-138-95 kubenswrapper[2576]: E0714 16:31:58.451804 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d\": container with ID starting with 8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d not found: ID does not exist" containerID="8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d" Jul 14 16:31:58.451873 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.451833 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d"} err="failed to get container status \"8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d\": rpc error: code = NotFound desc = could not find container \"8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d\": container with ID starting with 8861422bf439422953f48f7ea0c0f8bf5cbf72b4bd0ea36d7826a233696cf36d not found: ID does not exist" Jul 14 16:31:58.466536 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.466499 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f8bf88964-chjzm"] Jul 14 16:31:58.473050 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.473016 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f8bf88964-chjzm"] Jul 14 16:31:58.834766 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:58.834731 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a41f28-0d9c-4a77-887f-7ea27df19af6" path="/var/lib/kubelet/pods/d2a41f28-0d9c-4a77-887f-7ea27df19af6/volumes" Jul 14 16:31:59.308848 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:59.308806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:59.385284 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:59.385249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:31:59.448352 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:59.448317 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0e16dc1-7631-43c3-bd46-309850fd6b04" containerID="50863d01c49af51888ff0fc27380e1f02860179383612f5018b19d1bb4dfb485" exitCode=0 Jul 14 16:31:59.448789 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:59.448396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" event={"ID":"c0e16dc1-7631-43c3-bd46-309850fd6b04","Type":"ContainerDied","Data":"50863d01c49af51888ff0fc27380e1f02860179383612f5018b19d1bb4dfb485"} Jul 14 16:31:59.448857 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:31:59.448806 2576 scope.go:117] "RemoveContainer" containerID="50863d01c49af51888ff0fc27380e1f02860179383612f5018b19d1bb4dfb485" Jul 14 16:32:00.455735 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:00.455700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sl7nr" event={"ID":"c0e16dc1-7631-43c3-bd46-309850fd6b04","Type":"ContainerStarted","Data":"96fa046dddf337ce4db1f9f18e8be7a7f957d400cfc8e743420c15dd436f2471"} Jul 14 16:32:15.516356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:15.516315 2576 generic.go:356] "Generic (PLEG): container finished" podID="161661ad-b571-41df-937c-ac21eb815c2a" containerID="160532f869964630c37f0a697b1ec91c2bf7b86d8623456cc96220a08b88541b" exitCode=0 Jul 14 16:32:15.516762 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:15.516388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" event={"ID":"161661ad-b571-41df-937c-ac21eb815c2a","Type":"ContainerDied","Data":"160532f869964630c37f0a697b1ec91c2bf7b86d8623456cc96220a08b88541b"} Jul 14 16:32:15.516801 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:15.516771 2576 scope.go:117] "RemoveContainer" containerID="160532f869964630c37f0a697b1ec91c2bf7b86d8623456cc96220a08b88541b" Jul 14 16:32:16.522750 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:16.522712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5428r" event={"ID":"161661ad-b571-41df-937c-ac21eb815c2a","Type":"ContainerStarted","Data":"735ef632f722df468c07322adb1a0123078cd272407196f3049b0220efa74f63"} Jul 14 16:32:19.538788 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:19.538751 2576 generic.go:356] "Generic (PLEG): container finished" podID="0eb95d0c-006f-47b2-bb48-182ad2df3c57" containerID="f37b44224c762aa11aad1f22fd977b910d13a2c044f0e8cfaed599cb7118ce18" exitCode=0 Jul 14 16:32:19.539169 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:19.538828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" event={"ID":"0eb95d0c-006f-47b2-bb48-182ad2df3c57","Type":"ContainerDied","Data":"f37b44224c762aa11aad1f22fd977b910d13a2c044f0e8cfaed599cb7118ce18"} Jul 14 16:32:19.539210 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:19.539200 2576 scope.go:117] "RemoveContainer" containerID="f37b44224c762aa11aad1f22fd977b910d13a2c044f0e8cfaed599cb7118ce18" Jul 14 16:32:20.544615 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:20.544576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d7m55" event={"ID":"0eb95d0c-006f-47b2-bb48-182ad2df3c57","Type":"ContainerStarted","Data":"e89ed449a3ee1ae40dd6593d4ecc60cde74f7f0eb68a9c15165d39b617c01b52"} Jul 14 16:32:41.767630 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:41.767538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:41.836141 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:41.836102 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:43.470570 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:43.470532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:43.532646 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:43.532608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:43.605127 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:43.605058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:44.191859 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:44.191826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:44.355218 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:44.355175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:53.692002 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:53.691941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:53.762666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:53.762622 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:54.417650 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:54.417604 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:54.531185 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:54.531149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:54.635194 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:54.635164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:57.940526 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:57.940491 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:58.118673 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:58.118641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:58.219919 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:58.219825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:32:59.747753 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:32:59.747713 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:27.346332 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:27.346297 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:27.412645 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:27.412602 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:30.020807 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:30.020771 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:30.341292 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:30.341198 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:37.370649 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:37.370611 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:54.048534 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:54.048464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:33:54.113361 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:33:54.113320 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:11.642516 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:11.642311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:12.468093 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:12.468052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:15.456645 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:15.456610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:15.521997 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:15.521957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:20.095171 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:20.095116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:20.176576 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:20.176532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:33.058722 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:33.058682 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:33.215141 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:33.215090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:35.086245 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:35.086179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:35.653018 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:35.652977 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:36.426203 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.426160 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw"] Jul 14 16:34:36.426644 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.426528 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a41f28-0d9c-4a77-887f-7ea27df19af6" containerName="registry" Jul 14 16:34:36.426644 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.426542 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a41f28-0d9c-4a77-887f-7ea27df19af6" containerName="registry" Jul 14 16:34:36.426644 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.426596 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a41f28-0d9c-4a77-887f-7ea27df19af6" containerName="registry" Jul 14 16:34:36.429578 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.429554 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.432696 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.432674 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 16:34:36.434049 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.434028 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vxpx6\"" Jul 14 16:34:36.434170 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.434058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 16:34:36.443292 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.443258 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw"] Jul 14 16:34:36.592560 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.592523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c66fd223-019e-4c7d-81f7-52148b5fdceb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xg2nw\" (UID: \"c66fd223-019e-4c7d-81f7-52148b5fdceb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.592745 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.592643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kk7\" (UniqueName: \"kubernetes.io/projected/c66fd223-019e-4c7d-81f7-52148b5fdceb-kube-api-access-v7kk7\") pod \"cert-manager-cainjector-559cdd8c87-xg2nw\" (UID: \"c66fd223-019e-4c7d-81f7-52148b5fdceb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.693869 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.693771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kk7\" (UniqueName: \"kubernetes.io/projected/c66fd223-019e-4c7d-81f7-52148b5fdceb-kube-api-access-v7kk7\") pod \"cert-manager-cainjector-559cdd8c87-xg2nw\" (UID: \"c66fd223-019e-4c7d-81f7-52148b5fdceb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.693869 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.693826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c66fd223-019e-4c7d-81f7-52148b5fdceb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xg2nw\" (UID: \"c66fd223-019e-4c7d-81f7-52148b5fdceb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.705931 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.705896 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c66fd223-019e-4c7d-81f7-52148b5fdceb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xg2nw\" (UID: \"c66fd223-019e-4c7d-81f7-52148b5fdceb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.706062 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.706029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kk7\" (UniqueName: \"kubernetes.io/projected/c66fd223-019e-4c7d-81f7-52148b5fdceb-kube-api-access-v7kk7\") pod \"cert-manager-cainjector-559cdd8c87-xg2nw\" (UID: \"c66fd223-019e-4c7d-81f7-52148b5fdceb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.754796 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.754752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" Jul 14 16:34:36.896859 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.896830 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw"] Jul 14 16:34:36.899285 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:34:36.899255 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc66fd223_019e_4c7d_81f7_52148b5fdceb.slice/crio-a393150b1fd01634893842ab30aa5904182fd6ca5736af99d9b95cd15f3ab411 WatchSource:0}: Error finding container a393150b1fd01634893842ab30aa5904182fd6ca5736af99d9b95cd15f3ab411: Status 404 returned error can't find the container with id a393150b1fd01634893842ab30aa5904182fd6ca5736af99d9b95cd15f3ab411 Jul 14 16:34:36.994687 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:36.994655 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:37.061630 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:37.061594 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:37.115719 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:37.115687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" event={"ID":"c66fd223-019e-4c7d-81f7-52148b5fdceb","Type":"ContainerStarted","Data":"a393150b1fd01634893842ab30aa5904182fd6ca5736af99d9b95cd15f3ab411"} Jul 14 16:34:40.130576 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:40.130478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" event={"ID":"c66fd223-019e-4c7d-81f7-52148b5fdceb","Type":"ContainerStarted","Data":"82a76643cc01e5b6108e28e3b03c48a381a89a930d3ed0b1af992cf97fb5833c"} Jul 14 16:34:40.151735 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:40.151676 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xg2nw" podStartSLOduration=1.274126535 podStartE2EDuration="4.151658899s" totalImagesPullingTime="2.877532364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:40.150361311 +0000 UTC m=+295.880734830" watchObservedRunningTime="2026-07-14 16:34:40.151658899 +0000 UTC m=+295.882032417" Jul 14 16:34:40.589545 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:40.589513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:40.662571 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:40.662526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:43.641368 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:43.641314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:44.676192 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:44.676164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:34:44.677489 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:44.677465 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:34:44.683693 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:44.683654 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:34:44.684951 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:44.684920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:34:44.687632 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:44.687607 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 16:34:53.577804 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:53.577765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:53.679121 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:53.679078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:34:55.694612 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.694571 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr"] Jul 14 16:34:55.696961 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.696939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:55.700801 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.700774 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 16:34:55.702149 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.702128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-v7nqc\"" Jul 14 16:34:55.702267 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.702131 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 16:34:55.715557 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.715519 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr"] Jul 14 16:34:55.743674 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.743629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-847pl\" (UniqueName: \"kubernetes.io/projected/5875ab76-bff6-4ae0-9dab-3df307f02560-kube-api-access-847pl\") pod \"openshift-lws-operator-fd8ccff4c-7t5mr\" (UID: \"5875ab76-bff6-4ae0-9dab-3df307f02560\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:55.743873 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.743736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5875ab76-bff6-4ae0-9dab-3df307f02560-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7t5mr\" (UID: \"5875ab76-bff6-4ae0-9dab-3df307f02560\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:55.844876 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.844825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5875ab76-bff6-4ae0-9dab-3df307f02560-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7t5mr\" (UID: \"5875ab76-bff6-4ae0-9dab-3df307f02560\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:55.845061 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.844911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-847pl\" (UniqueName: \"kubernetes.io/projected/5875ab76-bff6-4ae0-9dab-3df307f02560-kube-api-access-847pl\") pod \"openshift-lws-operator-fd8ccff4c-7t5mr\" (UID: \"5875ab76-bff6-4ae0-9dab-3df307f02560\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:55.845261 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.845240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5875ab76-bff6-4ae0-9dab-3df307f02560-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7t5mr\" (UID: \"5875ab76-bff6-4ae0-9dab-3df307f02560\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:55.860585 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:55.860560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-847pl\" (UniqueName: \"kubernetes.io/projected/5875ab76-bff6-4ae0-9dab-3df307f02560-kube-api-access-847pl\") pod \"openshift-lws-operator-fd8ccff4c-7t5mr\" (UID: \"5875ab76-bff6-4ae0-9dab-3df307f02560\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:56.006899 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:56.006857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" Jul 14 16:34:56.151306 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:56.151267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr"] Jul 14 16:34:56.154746 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:34:56.154706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5875ab76_bff6_4ae0_9dab_3df307f02560.slice/crio-c2040d5d972ca2b28942f15b293de597c513ee77a540e03966d8aed4004c7841 WatchSource:0}: Error finding container c2040d5d972ca2b28942f15b293de597c513ee77a540e03966d8aed4004c7841: Status 404 returned error can't find the container with id c2040d5d972ca2b28942f15b293de597c513ee77a540e03966d8aed4004c7841 Jul 14 16:34:56.156320 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:56.156302 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 16:34:56.196001 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:56.195964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" event={"ID":"5875ab76-bff6-4ae0-9dab-3df307f02560","Type":"ContainerStarted","Data":"c2040d5d972ca2b28942f15b293de597c513ee77a540e03966d8aed4004c7841"} Jul 14 16:34:59.212777 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:59.212738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" event={"ID":"5875ab76-bff6-4ae0-9dab-3df307f02560","Type":"ContainerStarted","Data":"9721992edf1ad6481e69e0d059bb3ed2425778adf670409154a617e13564fb9e"} Jul 14 16:34:59.236860 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:34:59.236805 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7t5mr" podStartSLOduration=1.261489324 podStartE2EDuration="4.2367856s" totalImagesPullingTime="2.975296276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:34:59.236774964 +0000 UTC m=+314.967148483" watchObservedRunningTime="2026-07-14 16:34:59.2367856 +0000 UTC m=+314.967159118" Jul 14 16:35:00.569328 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:00.569295 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:00.671790 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:00.671751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:02.149789 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:02.149753 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:09.182096 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:09.182049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:09.283589 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:09.283551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:11.227951 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:11.227909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:11.397646 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:11.397606 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:13.588352 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:13.588314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:14.881117 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.881078 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st"] Jul 14 16:35:14.884324 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.884289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:14.890225 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.890183 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 16:35:14.890225 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.890201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 16:35:14.890448 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.890280 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 16:35:14.890558 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.890543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bkcjj\"" Jul 14 16:35:14.890787 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.890774 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 16:35:14.920230 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:14.920183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st"] Jul 14 16:35:15.016601 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.016556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f5e7327-19af-44a0-8b67-291d32f90c07-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.016814 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.016658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f5e7327-19af-44a0-8b67-291d32f90c07-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.016814 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.016722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f5e7327-19af-44a0-8b67-291d32f90c07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.016814 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.016764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f5e7327-19af-44a0-8b67-291d32f90c07-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.016967 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.016860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs82q\" (UniqueName: \"kubernetes.io/projected/0f5e7327-19af-44a0-8b67-291d32f90c07-kube-api-access-bs82q\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.041289 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.041256 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:15.117607 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.117563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs82q\" (UniqueName: \"kubernetes.io/projected/0f5e7327-19af-44a0-8b67-291d32f90c07-kube-api-access-bs82q\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.117607 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.117611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f5e7327-19af-44a0-8b67-291d32f90c07-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.117876 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.117637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f5e7327-19af-44a0-8b67-291d32f90c07-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.117876 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.117668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f5e7327-19af-44a0-8b67-291d32f90c07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.117876 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.117691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f5e7327-19af-44a0-8b67-291d32f90c07-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.118142 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.118113 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f5e7327-19af-44a0-8b67-291d32f90c07-manifests\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.120168 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.120140 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f5e7327-19af-44a0-8b67-291d32f90c07-tmp\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.120276 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.120251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f5e7327-19af-44a0-8b67-291d32f90c07-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.120372 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.120356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f5e7327-19af-44a0-8b67-291d32f90c07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.138659 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.138583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs82q\" (UniqueName: \"kubernetes.io/projected/0f5e7327-19af-44a0-8b67-291d32f90c07-kube-api-access-bs82q\") pod \"opendatahub-operator-controller-manager-b8dbf5fbb-759st\" (UID: \"0f5e7327-19af-44a0-8b67-291d32f90c07\") " pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.175976 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.175934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:15.195122 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.195079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:15.285193 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.285152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:15.367182 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.367154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st"] Jul 14 16:35:15.369594 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:35:15.369565 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5e7327_19af_44a0_8b67_291d32f90c07.slice/crio-166e820f9f4112e771f0ca9799b6fe5dc3e71f39ae0308889ff84c9e881c9541 WatchSource:0}: Error finding container 166e820f9f4112e771f0ca9799b6fe5dc3e71f39ae0308889ff84c9e881c9541: Status 404 returned error can't find the container with id 166e820f9f4112e771f0ca9799b6fe5dc3e71f39ae0308889ff84c9e881c9541 Jul 14 16:35:15.393470 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.393377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:15.507211 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.507179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:15.638319 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.638277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:15.761287 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:15.761254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:16.291440 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:16.291380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" event={"ID":"0f5e7327-19af-44a0-8b67-291d32f90c07","Type":"ContainerStarted","Data":"166e820f9f4112e771f0ca9799b6fe5dc3e71f39ae0308889ff84c9e881c9541"} Jul 14 16:35:18.301853 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:18.301816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" event={"ID":"0f5e7327-19af-44a0-8b67-291d32f90c07","Type":"ContainerStarted","Data":"25cccf80f9d574a92c2a30f89ba6b9534680be4d4b084cdc85f390fd4da7d32b"} Jul 14 16:35:20.312102 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:20.312066 2576 generic.go:356] "Generic (PLEG): container finished" podID="0f5e7327-19af-44a0-8b67-291d32f90c07" containerID="25cccf80f9d574a92c2a30f89ba6b9534680be4d4b084cdc85f390fd4da7d32b" exitCode=0 Jul 14 16:35:20.312523 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:20.312135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" event={"ID":"0f5e7327-19af-44a0-8b67-291d32f90c07","Type":"ContainerDied","Data":"25cccf80f9d574a92c2a30f89ba6b9534680be4d4b084cdc85f390fd4da7d32b"} Jul 14 16:35:20.562437 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:20.562307 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:20.740445 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:20.740413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:21.318478 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:21.318444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" event={"ID":"0f5e7327-19af-44a0-8b67-291d32f90c07","Type":"ContainerStarted","Data":"417b5828218bd448ec498b3cfe7ac89e37505d2e914f4bbcff39b4ef06a73af0"} Jul 14 16:35:21.318866 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:21.318757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:21.383760 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:21.383705 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" podStartSLOduration=2.517013442 podStartE2EDuration="7.38368629s" totalImagesPullingTime="3.735782296s" totalInitContainerRuntime="1.130890552s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:21.381482073 +0000 UTC m=+337.111855588" watchObservedRunningTime="2026-07-14 16:35:21.38368629 +0000 UTC m=+337.114059807" Jul 14 16:35:32.325938 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:32.325903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b8dbf5fbb-759st" Jul 14 16:35:34.796508 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:34.796470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:34.996723 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:34.996668 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:35.253983 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.253940 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7889f65889-v2q26"] Jul 14 16:35:35.265601 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.265560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.276502 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.276474 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tbmvd\"" Jul 14 16:35:35.276670 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.276535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 16:35:35.276670 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.276578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 16:35:35.276670 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.276579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 16:35:35.282193 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.282158 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7889f65889-v2q26"] Jul 14 16:35:35.298910 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.298877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-metrics-cert\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.299077 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.298921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-cert\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.299077 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.298946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-manager-config\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.299077 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.299016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w97zk\" (UniqueName: \"kubernetes.io/projected/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-kube-api-access-w97zk\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.399482 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.399436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-metrics-cert\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.399700 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.399495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-cert\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.399700 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.399521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-manager-config\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.399700 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.399555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w97zk\" (UniqueName: \"kubernetes.io/projected/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-kube-api-access-w97zk\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.400249 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.400222 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-manager-config\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.402323 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.402297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-metrics-cert\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.402466 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.402331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-cert\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.424153 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.424121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w97zk\" (UniqueName: \"kubernetes.io/projected/e23dfe28-b3cf-4bc8-a274-d4aee97c32ee-kube-api-access-w97zk\") pod \"lws-controller-manager-7889f65889-v2q26\" (UID: \"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee\") " pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.575624 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.575522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:35.748329 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:35:35.748300 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23dfe28_b3cf_4bc8_a274_d4aee97c32ee.slice/crio-3161d19bcd79d4d79632694e5765384d262af2fdb165d11d0f14d567a7bd4c80 WatchSource:0}: Error finding container 3161d19bcd79d4d79632694e5765384d262af2fdb165d11d0f14d567a7bd4c80: Status 404 returned error can't find the container with id 3161d19bcd79d4d79632694e5765384d262af2fdb165d11d0f14d567a7bd4c80 Jul 14 16:35:35.750088 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.750055 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7889f65889-v2q26"] Jul 14 16:35:35.797935 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:35.797897 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:36.098352 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:36.098318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:36.389464 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:36.389348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" event={"ID":"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee","Type":"ContainerStarted","Data":"3161d19bcd79d4d79632694e5765384d262af2fdb165d11d0f14d567a7bd4c80"} Jul 14 16:35:36.445587 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:36.445545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:37.188687 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:37.188648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:37.395929 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:37.395889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" event={"ID":"e23dfe28-b3cf-4bc8-a274-d4aee97c32ee","Type":"ContainerStarted","Data":"7dca4d7b5d816c6d3e24ddc0690f6cb06b2355716deffd787b0d718e7250f8bb"} Jul 14 16:35:37.396107 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:37.395949 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:37.425064 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:37.424999 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" podStartSLOduration=0.968670988 podStartE2EDuration="2.424981673s" totalImagesPullingTime="1.456310685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:37.424164198 +0000 UTC m=+353.154537718" watchObservedRunningTime="2026-07-14 16:35:37.424981673 +0000 UTC m=+353.155355190" Jul 14 16:35:37.541218 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:37.541182 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:41.015293 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:41.015240 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:41.698450 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:41.698382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:42.860528 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:42.860487 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:42.982116 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:42.982084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:44.685517 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.685477 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl"] Jul 14 16:35:44.690578 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.690546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.699538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.699505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 16:35:44.699729 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.699715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 16:35:44.699947 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.699923 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 16:35:44.700056 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.699926 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-brsbg\"" Jul 14 16:35:44.700256 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.700237 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 16:35:44.743351 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.743310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl"] Jul 14 16:35:44.772319 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.772534 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beadfa32-20ef-4960-aab9-c36b84272307-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.772534 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.772534 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/beadfa32-20ef-4960-aab9-c36b84272307-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.772534 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.772697 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/beadfa32-20ef-4960-aab9-c36b84272307-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.772697 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.772577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4jj\" (UniqueName: \"kubernetes.io/projected/beadfa32-20ef-4960-aab9-c36b84272307-kube-api-access-8x4jj\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.799817 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.799779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:44.873913 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.873867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beadfa32-20ef-4960-aab9-c36b84272307-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.873913 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.873912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.874207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.873933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/beadfa32-20ef-4960-aab9-c36b84272307-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.874207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.873962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.874207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.873979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/beadfa32-20ef-4960-aab9-c36b84272307-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.874207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.873998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4jj\" (UniqueName: \"kubernetes.io/projected/beadfa32-20ef-4960-aab9-c36b84272307-kube-api-access-8x4jj\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.874207 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.874016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.874915 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.874882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/beadfa32-20ef-4960-aab9-c36b84272307-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.876572 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.876549 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.876734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.876635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.876734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.876563 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/beadfa32-20ef-4960-aab9-c36b84272307-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.876734 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.876706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/beadfa32-20ef-4960-aab9-c36b84272307-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.891479 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.891448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4jj\" (UniqueName: \"kubernetes.io/projected/beadfa32-20ef-4960-aab9-c36b84272307-kube-api-access-8x4jj\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:44.907655 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:44.907612 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beadfa32-20ef-4960-aab9-c36b84272307-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-57hcl\" (UID: \"beadfa32-20ef-4960-aab9-c36b84272307\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:45.001108 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:45.001061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:45.167910 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:45.167880 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl"] Jul 14 16:35:45.169346 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:35:45.169317 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeadfa32_20ef_4960_aab9_c36b84272307.slice/crio-512846bca4e81d23d21bad05875803078883f9a62029aad7cc9e02f4531fe1bb WatchSource:0}: Error finding container 512846bca4e81d23d21bad05875803078883f9a62029aad7cc9e02f4531fe1bb: Status 404 returned error can't find the container with id 512846bca4e81d23d21bad05875803078883f9a62029aad7cc9e02f4531fe1bb Jul 14 16:35:45.437226 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:45.437129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" event={"ID":"beadfa32-20ef-4960-aab9-c36b84272307","Type":"ContainerStarted","Data":"512846bca4e81d23d21bad05875803078883f9a62029aad7cc9e02f4531fe1bb"} Jul 14 16:35:47.642638 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:47.642596 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:47.801062 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:47.801026 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:47.817799 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:47.817742 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:35:47.817935 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:47.817833 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 16:35:48.051039 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.051008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:48.402388 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.402352 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7889f65889-v2q26" Jul 14 16:35:48.456788 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.456753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" event={"ID":"beadfa32-20ef-4960-aab9-c36b84272307","Type":"ContainerStarted","Data":"06ecbc3faf7712c959a2aeda9da468e116bd1b2c7f30e534d6f106bde08f5b7c"} Jul 14 16:35:48.457003 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.456893 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:35:48.458635 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.458607 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-57hcl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 16:35:48.458730 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.458659 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" podUID="beadfa32-20ef-4960-aab9-c36b84272307" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 16:35:48.476120 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.476078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:48.509080 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.509018 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" podStartSLOduration=1.863153929 podStartE2EDuration="4.508997299s" totalImagesPullingTime="2.64584337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:35:48.50592149 +0000 UTC m=+364.236295009" watchObservedRunningTime="2026-07-14 16:35:48.508997299 +0000 UTC m=+364.239370820" Jul 14 16:35:48.723203 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.723101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:48.908231 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:48.908194 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:49.241024 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:49.240986 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:49.402338 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:49.402301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:49.462198 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:49.462161 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-57hcl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 16:35:49.462359 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:49.462207 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" podUID="beadfa32-20ef-4960-aab9-c36b84272307" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 16:35:50.433171 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:50.433122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:50.684448 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:50.684317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:50.865312 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:50.865269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:35:52.462380 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:35:52.462343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-57hcl" Jul 14 16:36:09.311777 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:09.311735 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:36.602100 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:36.602053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:36.948849 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:36.948750 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:37.128980 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:37.128946 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:44.951170 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:44.951130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:45.042288 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:45.042248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:55.613441 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:55.613374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:36:55.779614 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:36:55.779580 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:00.200178 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:00.200133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:04.224720 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:04.224679 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:07.391790 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:07.391697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:10.353386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:10.353345 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:11.459358 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:11.459315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:11.814185 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:11.814150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:12.599058 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:12.599020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:13.633247 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:13.633207 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:16.062557 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:16.062527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:16.194178 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:16.194136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:17.432966 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:17.432918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:17.531750 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:17.531714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:21.187651 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:21.187615 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:21.294517 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:21.294473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:22.226972 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:22.226916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:22.478584 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:22.478498 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:24.797994 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:24.797959 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:24.901666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:24.901613 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:32.895067 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:32.895030 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:33.132141 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:33.132090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:35.773036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:35.772999 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:35.973012 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:35.972968 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:38.195083 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:38.195044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:38.402992 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:38.402954 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:41.849466 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:41.849398 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:42.051287 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:42.051246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:50.613926 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:50.613873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:50.714902 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:50.714864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:53.211633 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:53.211595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:53.309935 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:53.309897 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:56.399809 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:56.399769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:37:56.500121 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:37:56.500080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:00.261759 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:00.261724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:00.588809 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:00.588714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:01.437432 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:01.437384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:01.645093 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:01.645050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:01.763420 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:01.763367 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:03.841024 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:03.840971 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:03.952015 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:03.951975 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:04.056004 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.055972 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:04.337334 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.337294 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:38:04.341137 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.341107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.344965 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.344936 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 16:38:04.346166 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.346136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8xkxt\"" Jul 14 16:38:04.346166 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.346143 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 16:38:04.346343 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.346142 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 16:38:04.352084 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.352054 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:38:04.398543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.398506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:38:04.525341 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.525305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292k4\" (UniqueName: \"kubernetes.io/projected/90ee21b5-9ebe-4ac8-91b0-9b478754c224-kube-api-access-292k4\") pod \"limitador-limitador-54d6d988d5-ltf7d\" (UID: \"90ee21b5-9ebe-4ac8-91b0-9b478754c224\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.525553 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.525461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90ee21b5-9ebe-4ac8-91b0-9b478754c224-config-file\") pod \"limitador-limitador-54d6d988d5-ltf7d\" (UID: \"90ee21b5-9ebe-4ac8-91b0-9b478754c224\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.626918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.626817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90ee21b5-9ebe-4ac8-91b0-9b478754c224-config-file\") pod \"limitador-limitador-54d6d988d5-ltf7d\" (UID: \"90ee21b5-9ebe-4ac8-91b0-9b478754c224\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.626918 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.626881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-292k4\" (UniqueName: \"kubernetes.io/projected/90ee21b5-9ebe-4ac8-91b0-9b478754c224-kube-api-access-292k4\") pod \"limitador-limitador-54d6d988d5-ltf7d\" (UID: \"90ee21b5-9ebe-4ac8-91b0-9b478754c224\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.627593 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.627569 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/90ee21b5-9ebe-4ac8-91b0-9b478754c224-config-file\") pod \"limitador-limitador-54d6d988d5-ltf7d\" (UID: \"90ee21b5-9ebe-4ac8-91b0-9b478754c224\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.639125 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.639098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-292k4\" (UniqueName: \"kubernetes.io/projected/90ee21b5-9ebe-4ac8-91b0-9b478754c224-kube-api-access-292k4\") pod \"limitador-limitador-54d6d988d5-ltf7d\" (UID: \"90ee21b5-9ebe-4ac8-91b0-9b478754c224\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.653244 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.653207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:04.813367 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.813332 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:38:04.815093 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:38:04.815057 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ee21b5_9ebe_4ac8_91b0_9b478754c224.slice/crio-8b429bbfe64ca1f8185d75d82fba3ba662e4d16b1b3c7aa2ce8dd39ad71c0f74 WatchSource:0}: Error finding container 8b429bbfe64ca1f8185d75d82fba3ba662e4d16b1b3c7aa2ce8dd39ad71c0f74: Status 404 returned error can't find the container with id 8b429bbfe64ca1f8185d75d82fba3ba662e4d16b1b3c7aa2ce8dd39ad71c0f74 Jul 14 16:38:04.993602 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:04.993569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:05.088450 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:05.088390 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" event={"ID":"90ee21b5-9ebe-4ac8-91b0-9b478754c224","Type":"ContainerStarted","Data":"8b429bbfe64ca1f8185d75d82fba3ba662e4d16b1b3c7aa2ce8dd39ad71c0f74"} Jul 14 16:38:05.106649 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:05.106616 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:07.621546 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:07.621499 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:07.722276 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:07.722221 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:08.113046 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:08.113001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" event={"ID":"90ee21b5-9ebe-4ac8-91b0-9b478754c224","Type":"ContainerStarted","Data":"d1e7f22877e7968b76552c0cd5a2974c5dd26339fa133769d34bc7efbd06ee8d"} Jul 14 16:38:08.113263 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:08.113137 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:08.135216 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:08.135155 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" podStartSLOduration=1.359424729 podStartE2EDuration="4.135136907s" totalImagesPullingTime="2.775712178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:38:08.134124713 +0000 UTC m=+503.864498231" watchObservedRunningTime="2026-07-14 16:38:08.135136907 +0000 UTC m=+503.865510425" Jul 14 16:38:09.795044 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:09.794981 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:09.895775 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:09.895725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:10.074422 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:10.074316 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:10.231147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:10.231111 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:19.119314 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:19.119274 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ltf7d" Jul 14 16:38:25.437025 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:25.436980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:28.775544 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:28.775493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:37.669429 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:37.669324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:37.912490 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:37.912445 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:44.533557 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:44.533517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:44.639683 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:44.639643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:44.740615 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:44.740576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:44.868920 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:44.868780 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:48.159370 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:48.159326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:48.260961 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:48.260925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:38:52.482961 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:38:52.482917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:19.426827 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:19.426786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:19.520979 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:19.520943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:21.252280 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:21.252245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:21.724223 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:21.724113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:21.875702 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:21.875643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:22.191837 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:22.191796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:22.280957 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:22.280923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:22.481763 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:22.481726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:39:29.662055 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:29.662008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:31.593803 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:31.593757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:31.702268 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:31.702228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:37.674330 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:37.674281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:38.202504 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:38.202460 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:39:44.493660 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.493615 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr"] Jul 14 16:39:44.498448 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.498394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.502910 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.502879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 16:39:44.503097 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.502942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 16:39:44.503097 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.502879 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6g4q6\"" Jul 14 16:39:44.503097 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.502881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 16:39:44.508538 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.508508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr"] Jul 14 16:39:44.520429 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.520115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.520429 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.520173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.520429 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.520310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.520429 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.520376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.520896 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.520859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fcl2\" (UniqueName: \"kubernetes.io/projected/a3ba143d-59fa-4f45-918b-d518a1087f0f-kube-api-access-5fcl2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.521004 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.520976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ba143d-59fa-4f45-918b-d518a1087f0f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.530337 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.530304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:44.621807 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.621766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ba143d-59fa-4f45-918b-d518a1087f0f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.621807 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.621816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.621850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.621904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.621944 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.621984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fcl2\" (UniqueName: \"kubernetes.io/projected/a3ba143d-59fa-4f45-918b-d518a1087f0f-kube-api-access-5fcl2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622271 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.622244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622333 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.622306 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.622386 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.622373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.624419 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.624375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ba143d-59fa-4f45-918b-d518a1087f0f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.624566 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.624537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ba143d-59fa-4f45-918b-d518a1087f0f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.632358 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.632327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fcl2\" (UniqueName: \"kubernetes.io/projected/a3ba143d-59fa-4f45-918b-d518a1087f0f-kube-api-access-5fcl2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l4rxr\" (UID: \"a3ba143d-59fa-4f45-918b-d518a1087f0f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.706246 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.706216 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:39:44.706454 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.706392 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:39:44.714070 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.714043 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:39:44.714235 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.714044 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:39:44.815273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.815174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6g4q6\"" Jul 14 16:39:44.822964 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.822928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:44.975784 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:44.975750 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr"] Jul 14 16:39:44.977606 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:39:44.977574 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ba143d_59fa_4f45_918b_d518a1087f0f.slice/crio-6de4d361b25b5ce644419ca2fde1e8901d2829d65833772e20eba3914cd4a993 WatchSource:0}: Error finding container 6de4d361b25b5ce644419ca2fde1e8901d2829d65833772e20eba3914cd4a993: Status 404 returned error can't find the container with id 6de4d361b25b5ce644419ca2fde1e8901d2829d65833772e20eba3914cd4a993 Jul 14 16:39:45.298910 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:45.298726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:39:45.572202 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:45.572096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" event={"ID":"a3ba143d-59fa-4f45-918b-d518a1087f0f","Type":"ContainerStarted","Data":"6de4d361b25b5ce644419ca2fde1e8901d2829d65833772e20eba3914cd4a993"} Jul 14 16:39:46.228742 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:46.228707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:46.578524 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:46.578488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" event={"ID":"a3ba143d-59fa-4f45-918b-d518a1087f0f","Type":"ContainerStarted","Data":"4f26ef8bdcb40fe16da25529acb8c29e4ec89f8b07d683c4efa1b4cd43c0f8c7"} Jul 14 16:39:46.603423 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:46.603347 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" podStartSLOduration=1.557261133 podStartE2EDuration="2.60332755s" totalImagesPullingTime="1.046066417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:39:46.601326606 +0000 UTC m=+602.331700127" watchObservedRunningTime="2026-07-14 16:39:46.60332755 +0000 UTC m=+602.333701068" Jul 14 16:39:51.640641 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:51.640597 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:39:52.795826 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:52.795785 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:39:54.823519 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:54.823478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:54.825827 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:54.823542 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:54.836696 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:54.836661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:39:55.633382 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:39:55.633343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l4rxr" Jul 14 16:40:04.464913 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:04.464869 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:40:05.996811 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:05.996777 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:40:21.998731 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:21.998687 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2"] Jul 14 16:40:22.005677 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.005645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.009631 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.009593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 16:40:22.013797 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.013696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2"] Jul 14 16:40:22.044118 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.044074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:40:22.168821 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.168779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kcp\" (UniqueName: \"kubernetes.io/projected/5f2e9adf-de15-4e16-b331-91911ad0dcd7-kube-api-access-67kcp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.169019 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.168866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.169019 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.168941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.169019 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.168967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.169134 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.169017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.169134 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.169064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f2e9adf-de15-4e16-b331-91911ad0dcd7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f2e9adf-de15-4e16-b331-91911ad0dcd7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270147 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kcp\" (UniqueName: \"kubernetes.io/projected/5f2e9adf-de15-4e16-b331-91911ad0dcd7-kube-api-access-67kcp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270543 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270710 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270710 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.270810 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.270731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.272593 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.272562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f2e9adf-de15-4e16-b331-91911ad0dcd7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.272762 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.272744 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f2e9adf-de15-4e16-b331-91911ad0dcd7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.280126 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.280095 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kcp\" (UniqueName: \"kubernetes.io/projected/5f2e9adf-de15-4e16-b331-91911ad0dcd7-kube-api-access-67kcp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrzt2\" (UID: \"5f2e9adf-de15-4e16-b331-91911ad0dcd7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.317346 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.317303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:22.463785 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.463741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2"] Jul 14 16:40:22.466472 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:40:22.466442 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2e9adf_de15_4e16_b331_91911ad0dcd7.slice/crio-86ad8c8c28550af7a80e227403e3127717da160d55f4609d2d3b2e063422a23d WatchSource:0}: Error finding container 86ad8c8c28550af7a80e227403e3127717da160d55f4609d2d3b2e063422a23d: Status 404 returned error can't find the container with id 86ad8c8c28550af7a80e227403e3127717da160d55f4609d2d3b2e063422a23d Jul 14 16:40:22.468262 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.468238 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 16:40:22.750555 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.750515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" event={"ID":"5f2e9adf-de15-4e16-b331-91911ad0dcd7","Type":"ContainerStarted","Data":"9867f14bd074109a4f08d312d2fe4ac62f001a20a42b42b170e21c0d3404ab02"} Jul 14 16:40:22.750732 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.750576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" event={"ID":"5f2e9adf-de15-4e16-b331-91911ad0dcd7","Type":"ContainerStarted","Data":"86ad8c8c28550af7a80e227403e3127717da160d55f4609d2d3b2e063422a23d"} Jul 14 16:40:22.773813 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:22.773749 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" podStartSLOduration=1.5820945690000001 podStartE2EDuration="1.77373092s" totalImagesPullingTime="191.636351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:40:22.771479396 +0000 UTC m=+638.501852914" watchObservedRunningTime="2026-07-14 16:40:22.77373092 +0000 UTC m=+638.504104438" Jul 14 16:40:24.011197 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:24.011159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:40:32.318254 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:32.318214 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:32.318686 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:32.318306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:32.331302 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:32.331269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:32.810083 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:32.810052 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrzt2" Jul 14 16:40:43.013416 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.013373 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984"] Jul 14 16:40:43.016849 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.016809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.020620 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.020595 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 16:40:43.032929 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.032898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984"] Jul 14 16:40:43.056054 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.056013 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:40:43.062075 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.062039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.062075 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.062079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96t8w\" (UniqueName: \"kubernetes.io/projected/64adf9dd-5132-4940-94c4-21ee904bc0cd-kube-api-access-96t8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.062250 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.062106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.062250 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.062230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.062314 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.062276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64adf9dd-5132-4940-94c4-21ee904bc0cd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.062314 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.062303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.163590 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.163544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.163590 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.163593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96t8w\" (UniqueName: \"kubernetes.io/projected/64adf9dd-5132-4940-94c4-21ee904bc0cd-kube-api-access-96t8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.163809 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.163630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.163809 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.163679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.163969 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.163819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64adf9dd-5132-4940-94c4-21ee904bc0cd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.163969 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.163871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.164084 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.164020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.164143 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.164088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.164245 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.164212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.166036 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.166015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64adf9dd-5132-4940-94c4-21ee904bc0cd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.166417 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.166382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64adf9dd-5132-4940-94c4-21ee904bc0cd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.175883 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.175841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96t8w\" (UniqueName: \"kubernetes.io/projected/64adf9dd-5132-4940-94c4-21ee904bc0cd-kube-api-access-96t8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-js984\" (UID: \"64adf9dd-5132-4940-94c4-21ee904bc0cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.328129 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.328027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:43.473257 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.473227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984"] Jul 14 16:40:43.475879 ip-10-0-138-95 kubenswrapper[2576]: W0714 16:40:43.475850 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64adf9dd_5132_4940_94c4_21ee904bc0cd.slice/crio-0c390c4c2d05ddd9e6971115d433f2d7d3786146cf3795e60ed2fdeee7a97e53 WatchSource:0}: Error finding container 0c390c4c2d05ddd9e6971115d433f2d7d3786146cf3795e60ed2fdeee7a97e53: Status 404 returned error can't find the container with id 0c390c4c2d05ddd9e6971115d433f2d7d3786146cf3795e60ed2fdeee7a97e53 Jul 14 16:40:43.853319 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.853271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" event={"ID":"64adf9dd-5132-4940-94c4-21ee904bc0cd","Type":"ContainerStarted","Data":"6273a40ba9d05e81322d9899142d71120f511b7a0179c90021be7227748b34ef"} Jul 14 16:40:43.853319 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.853319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" event={"ID":"64adf9dd-5132-4940-94c4-21ee904bc0cd","Type":"ContainerStarted","Data":"0c390c4c2d05ddd9e6971115d433f2d7d3786146cf3795e60ed2fdeee7a97e53"} Jul 14 16:40:43.873685 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:43.873630 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" podStartSLOduration=1.6728448500000002 podStartE2EDuration="1.873608738s" totalImagesPullingTime="200.763888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:40:43.872228424 +0000 UTC m=+659.602601954" watchObservedRunningTime="2026-07-14 16:40:43.873608738 +0000 UTC m=+659.603982255" Jul 14 16:40:45.799863 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:45.799822 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:40:53.328842 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:53.328782 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:53.328842 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:53.328851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:53.342786 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:53.342754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:40:53.915583 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:40:53.915548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-js984" Jul 14 16:41:28.602838 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:41:28.602792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:41:28.702934 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:41:28.702898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:41:29.784239 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:41:29.784195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:41:29.908639 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:41:29.908596 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:42:00.592067 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:00.591973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:42:11.492797 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:11.492752 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:42:21.992621 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:21.992580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:42:28.515574 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:28.515539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:42:30.517043 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:30.517001 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:42:36.563848 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:36.563803 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:42:39.342982 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:39.342945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:42:41.001933 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:41.001892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:42:44.315608 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:44.315566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:42:46.301893 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:46.301850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:42:52.265061 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:42:52.265017 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:10.108548 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:10.108457 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:43:22.317780 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:22.317725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:43:27.521025 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:27.520979 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:27.620956 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:27.620908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:27.750610 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:27.750569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:34.126950 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:34.126902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:34.204829 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:34.204786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:34.288610 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:34.288576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:34.388020 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:34.387923 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:34.542244 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:34.542201 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:40.938892 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:40.938850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:41.049708 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:41.049664 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:43:57.408947 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:57.408908 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:43:58.060627 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:43:58.060590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:44:04.903555 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:04.903514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:44:15.110931 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:15.110887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:44:23.519558 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:23.519514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:44:35.019797 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:35.019760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:44:43.692560 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:43.692460 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:44:44.743579 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:44.743539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:44:44.744034 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:44.743739 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:44:44.750707 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:44.750679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:44:44.750885 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:44.750679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:44:55.698050 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:44:55.698008 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:45:05.308369 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:45:05.308318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:45:28.197710 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:45:28.197671 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:45:38.095675 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:45:38.095631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:45:49.376902 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:45:49.376862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:46:02.991656 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:46:02.991617 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:46:13.298105 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:46:13.298011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:46:30.694920 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:46:30.694880 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:46:39.603735 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:46:39.603692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:46:50.896545 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:46:50.896504 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:47:00.202415 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:47:00.202363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:47:09.095995 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:47:09.095954 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:48:22.741969 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:48:22.741932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:48:57.313685 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:48:57.313645 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:49:07.008186 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:07.008072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:49:07.157183 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:07.157145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:49:08.899227 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:08.899184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:49:20.312718 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:20.312677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:49:22.513070 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:22.513035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:49:32.711340 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:32.711290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:49:44.033833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:44.033787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:49:44.773460 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:44.773425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:49:44.774808 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:44.774782 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:49:44.780325 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:44.780297 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:49:44.781623 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:44.781596 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:49:54.310399 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:49:54.310358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:50:02.414271 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:50:02.414232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:50:13.825564 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:50:13.825524 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:50:24.611866 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:50:24.611829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:50:35.013730 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:50:35.013693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:50:46.115295 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:50:46.115202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:51:09.224892 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:51:09.224847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:51:18.640438 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:51:18.640380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:51:27.611242 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:51:27.611195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:51:38.911329 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:51:38.911286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:51:55.129650 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:51:55.129608 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:52:04.714709 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:52:04.714670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:52:14.208485 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:52:14.208358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:52:24.407696 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:52:24.407649 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:52:33.326119 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:52:33.326076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:52:42.616544 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:52:42.616498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:52:56.216133 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:52:56.216089 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:53:05.812640 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:53:05.812595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:53:15.111626 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:53:15.111587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:53:27.005744 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:53:27.005700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:53:46.608300 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:53:46.608204 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:53:50.015954 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:53:50.015919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:53:59.322956 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:53:59.322911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:54:11.123124 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:11.123081 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:54:22.322197 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:22.322153 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:54:25.562936 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:25.562903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:31.044458 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:31.044387 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:54:35.269738 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:35.269704 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:43.590353 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:43.590305 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:44.711576 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:44.711541 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:54:44.802461 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:44.802427 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:54:44.804796 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:44.804765 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:54:44.809972 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:44.809944 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:54:44.812356 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:44.812332 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:54:49.325833 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:49.325794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:51.920307 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:51.920270 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:52.079679 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:52.079642 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:52.954037 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:52.953994 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:54:54.132607 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:54.132567 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:59.467115 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:59.466999 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:59.584660 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:59.584624 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:59.840780 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:59.840694 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:54:59.987113 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:54:59.987078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:01.125515 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:01.125478 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:01.358294 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:01.358259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:01.554664 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:01.554629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:01.809629 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:01.809535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:02.339832 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:02.339795 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:02.440033 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:02.439995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:03.821893 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:03.821851 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:05.715981 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:05.715939 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:55:06.495571 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:06.495454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:06.593826 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:06.593789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:06.725385 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:06.725348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:09.070499 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:09.070464 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:13.416801 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:13.416765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:13.520126 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:13.520090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:13.802488 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:13.802448 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:13.990696 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:13.990662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:14.047172 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:14.047130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:55:15.013732 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:15.013686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:15.142855 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:15.142815 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:15.267785 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:15.267689 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:15.967535 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:15.967494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:16.543044 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:16.543009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:17.122243 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:17.122210 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:17.252273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:17.252239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:20.137747 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:20.137700 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:20.609657 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:20.609618 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:26.583027 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:26.582994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:26.684064 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:26.684027 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:28.670519 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:28.670484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:33.850290 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:33.850251 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:33.961061 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:33.961022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:34.168188 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:34.168104 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:34.296208 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:34.296174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:35.454174 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:35.454131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:35.611165 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:35.611119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:36.374435 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:36.374375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:36.480484 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:36.480434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:37.274709 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:37.274677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:37.913570 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:37.913533 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:55:39.796900 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:39.796859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:40.029836 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:40.029802 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:40.814171 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:40.814131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:40.932980 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:40.932942 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:41.433010 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:41.432977 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:46.412613 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:46.412569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:55:48.358524 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:48.358490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:48.447800 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:48.447757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:50.581732 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:50.581672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:57.919310 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:57.919273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:58.041886 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:58.041854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:58.166697 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:58.166653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:58.325345 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:58.325304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:58.615949 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:58.615859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:55:58.914656 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:55:58.914566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:26.222652 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:26.222600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:30.607536 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:30.607494 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:31.963961 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:31.963920 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:32.108098 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:32.108064 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:32.272916 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:32.272884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:38.127360 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:38.127269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:48.383744 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:48.383708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:55.024172 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:55.024132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:55.166743 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:55.166700 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:56:55.318770 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:56:55.318677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:05.910831 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:05.910793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:07.154122 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:07.154084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:13.924768 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:13.924728 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:14.048143 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:14.048107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:14.545372 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:14.545337 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:14.747693 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:14.747662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:15.620337 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:15.620300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:57:16.559687 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:16.559648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:23.014775 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:23.014735 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:57:23.449038 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:23.448955 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:23.556109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:23.556071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:24.208011 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:24.207978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:30.405727 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:30.405684 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:57:31.678719 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:31.678675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:31.791145 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:31.791112 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:31.954109 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:31.954017 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:32.327529 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:32.327493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:32.675928 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:32.675832 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:36.004850 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:36.004800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:36.135177 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:36.135146 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:36.537536 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:36.537496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:36.777021 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:36.776986 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:37.227506 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:37.227461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:37.353530 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:37.353496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:39.921121 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:39.921080 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:57:40.395919 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:40.395883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:41.114851 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:41.114817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:41.227395 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:41.227361 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:41.554752 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:41.554714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:48.411383 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:48.411345 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:48.500113 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:48.500076 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:48.893942 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:48.893901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:49.301201 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:49.301161 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:49.412870 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:49.412835 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:52.419489 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:52.419439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:57:56.101957 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:56.101918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:56.293189 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:56.293148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:56.507282 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:56.507243 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:56.728117 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:56.728078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:56.972129 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:56.972046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:57:57.257870 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:57:57.257836 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:04.046995 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:04.046957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:04.149619 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:04.149584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:04.273660 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:04.273619 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:05.090267 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:05.090231 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:10.329514 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:10.329432 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:11.812306 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:11.812264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:12.208972 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:12.208881 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:12.402169 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:12.402105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:19.208980 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:19.208936 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:19.640273 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:19.640234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:20.073515 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:20.073475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:23.205125 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:23.205082 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:23.333234 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:23.333196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:23.802581 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:23.802537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:24.143425 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:24.143314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:24.560103 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:24.560066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:27.610567 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:27.610528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:58:27.636320 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:27.636281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:41.715893 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:41.715855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:58:45.422117 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:58:45.422070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:59:08.629534 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:08.629485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:59:11.032527 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:11.032486 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:59:13.427347 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:13.427304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:59:17.143437 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:17.143366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:59:22.223341 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:22.223302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:59:22.424666 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:22.424623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 16:59:42.949344 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:42.949305 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 16:59:44.832181 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:44.832146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:59:44.840075 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:44.840045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:59:44.844724 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:44.844699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 16:59:44.851518 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:44.851492 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 16:59:59.083907 ip-10-0-138-95 kubenswrapper[2576]: I0714 16:59:59.083866 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:01.831122 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:01.831085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:02.309639 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:02.309599 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:00:03.569043 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:03.569004 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:08.791894 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:08.791856 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:09.001394 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:09.001357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:09.223487 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:09.223344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:09.490092 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:09.490062 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:10.763715 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:10.763675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:10.922092 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:10.922059 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:11.802758 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:11.802722 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:11.916448 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:11.916368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:12.022060 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:12.022022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:13.573035 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:13.573003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:13.722373 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:13.722332 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:00:20.375193 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:20.375153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:20.485331 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:20.485300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:21.283120 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:21.283085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:28.511578 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:28.511539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:28.853285 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:28.853188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:29.037184 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:29.037143 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:00:39.381020 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:39.380978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:00:39.793005 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:00:39.792964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:00.957009 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:00.956972 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:08.227967 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:08.227882 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:08.339945 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:08.339911 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:08.659005 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:08.658969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:09.082474 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:09.082440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:09.247333 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:09.247295 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:12.384794 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:12.384759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:12.545383 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:12.545349 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:12.660116 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:12.660028 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:12.890793 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:12.890761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:13.392915 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:13.392880 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:13.498526 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:13.498488 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:16.793161 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:16.793125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:17.314845 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:17.314809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:17.702346 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:17.702245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:18.058700 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:18.058656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:20.335613 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:20.335571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:01:21.191280 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:21.191246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:21.339759 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:21.339714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:21.604792 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:21.604760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:22.058585 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:22.058546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:22.173009 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:22.172974 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:25.694881 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:25.694841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:30.722538 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:30.722498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:01:32.666530 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:32.666490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:34.527827 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:34.527763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:34.629189 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:34.629134 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:43.032561 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:43.032522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:43.159551 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:43.159511 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:46.467164 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:46.467129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:01:49.329810 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:49.329768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:01:56.625185 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:01:56.625145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:24.110458 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.110386 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx"] Jul 14 17:02:24.114088 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.114058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.117436 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.117396 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3a7c08\"/\"kube-root-ca.crt\"" Jul 14 17:02:24.117578 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.117395 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3a7c08\"/\"openshift-service-ca.crt\"" Jul 14 17:02:24.118811 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.118789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3a7c08\"/\"default-dockercfg-pb7d4\"" Jul 14 17:02:24.119009 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.118990 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3a7c08\"/\"test-model-3a7c08-kserve-self-signed-certs\"" Jul 14 17:02:24.129226 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.129190 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx"] Jul 14 17:02:24.223593 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.223554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:24.249434 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.249368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-model-cache\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.249434 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.249424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdrl\" (UniqueName: \"kubernetes.io/projected/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-kube-api-access-rcdrl\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.249648 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.249527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tls-certs\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.249648 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.249574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-dshm\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.249716 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.249645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-home\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.249716 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.249666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tmp-dir\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.350694 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.350630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-home\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.350694 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.350686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tmp-dir\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.350928 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.350748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-model-cache\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.350928 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.350771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdrl\" (UniqueName: \"kubernetes.io/projected/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-kube-api-access-rcdrl\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.350928 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.350834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tls-certs\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.350928 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.350875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-dshm\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.351146 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.351126 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-home\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.351185 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.351165 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tmp-dir\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.351228 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.351208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-model-cache\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.353297 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.353264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-dshm\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.353490 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.353422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tls-certs\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.364061 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.363980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdrl\" (UniqueName: \"kubernetes.io/projected/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-kube-api-access-rcdrl\") pod \"test-model-3a7c08-kserve-55f5cfc49-hrpgx\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.423975 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.423933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:24.574143 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:24.574110 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx"] Jul 14 17:02:24.576870 ip-10-0-138-95 kubenswrapper[2576]: W0714 17:02:24.576844 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7f62e4e_dc3f_49e8_a917_2368d9b2ffca.slice/crio-5c6f0a51fb20a231e3b25f514bad2af14744952a5065b77fdab5ac0b1d3760c8 WatchSource:0}: Error finding container 5c6f0a51fb20a231e3b25f514bad2af14744952a5065b77fdab5ac0b1d3760c8: Status 404 returned error can't find the container with id 5c6f0a51fb20a231e3b25f514bad2af14744952a5065b77fdab5ac0b1d3760c8 Jul 14 17:02:25.176885 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:25.176844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" event={"ID":"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca","Type":"ContainerStarted","Data":"7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873"} Jul 14 17:02:25.177309 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:25.176894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" event={"ID":"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca","Type":"ContainerStarted","Data":"5c6f0a51fb20a231e3b25f514bad2af14744952a5065b77fdab5ac0b1d3760c8"} Jul 14 17:02:25.202055 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:25.202002 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" podStartSLOduration=1.201983483 podStartE2EDuration="1.201983483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:02:25.201381236 +0000 UTC m=+1960.931754753" watchObservedRunningTime="2026-07-14 17:02:25.201983483 +0000 UTC m=+1960.932357001" Jul 14 17:02:28.113210 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:28.113174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:02:34.424568 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:34.424525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:34.425051 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:34.424597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:34.437577 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:34.437544 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:35.242677 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:35.242644 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:02:41.311110 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:41.311030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:02:45.528317 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:45.528280 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:46.595382 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:46.595347 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx"] Jul 14 17:02:46.618291 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:46.618260 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:46.838471 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:46.838391 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:47.279835 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:47.279800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:47.591475 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:47.591365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:47.760618 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:47.760584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:47.990694 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:47.990660 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:52.279265 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:52.279227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:02:58.022096 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:02:58.022054 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:03:01.616314 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:01.616248 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" podUID="d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" containerName="main" containerID="cri-o://7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873" gracePeriod=45 Jul 14 17:03:01.869494 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:01.869393 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:03:02.006299 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006253 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-dshm\") pod \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " Jul 14 17:03:02.006299 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006301 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-model-cache\") pod \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " Jul 14 17:03:02.006566 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006325 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcdrl\" (UniqueName: \"kubernetes.io/projected/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-kube-api-access-rcdrl\") pod \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " Jul 14 17:03:02.006566 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-home\") pod \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " Jul 14 17:03:02.006566 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tmp-dir\") pod \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " Jul 14 17:03:02.006566 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006449 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tls-certs\") pod \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\" (UID: \"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca\") " Jul 14 17:03:02.006778 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006670 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" (UID: "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:02.006778 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006682 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-home" (OuterVolumeSpecName: "home") pod "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" (UID: "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:02.006778 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006709 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" (UID: "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:02.006914 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006782 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-model-cache\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:03:02.006914 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006796 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-home\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:03:02.006914 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.006804 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tmp-dir\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:03:02.008810 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.008773 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-dshm" (OuterVolumeSpecName: "dshm") pod "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" (UID: "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:03:02.008810 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.008771 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" (UID: "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:03:02.008986 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.008883 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-kube-api-access-rcdrl" (OuterVolumeSpecName: "kube-api-access-rcdrl") pod "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" (UID: "d7f62e4e-dc3f-49e8-a917-2368d9b2ffca"). InnerVolumeSpecName "kube-api-access-rcdrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:03:02.107746 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.107682 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-dshm\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:03:02.107746 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.107737 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcdrl\" (UniqueName: \"kubernetes.io/projected/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-kube-api-access-rcdrl\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:03:02.107746 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.107752 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca-tls-certs\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:03:02.363564 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.363527 2576 generic.go:356] "Generic (PLEG): container finished" podID="d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" containerID="7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873" exitCode=0 Jul 14 17:03:02.363564 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.363575 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" Jul 14 17:03:02.363789 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.363611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" event={"ID":"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca","Type":"ContainerDied","Data":"7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873"} Jul 14 17:03:02.363789 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.363659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx" event={"ID":"d7f62e4e-dc3f-49e8-a917-2368d9b2ffca","Type":"ContainerDied","Data":"5c6f0a51fb20a231e3b25f514bad2af14744952a5065b77fdab5ac0b1d3760c8"} Jul 14 17:03:02.363789 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.363676 2576 scope.go:117] "RemoveContainer" containerID="7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873" Jul 14 17:03:02.373253 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.373233 2576 scope.go:117] "RemoveContainer" containerID="7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873" Jul 14 17:03:02.373600 ip-10-0-138-95 kubenswrapper[2576]: E0714 17:03:02.373581 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873\": container with ID starting with 7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873 not found: ID does not exist" containerID="7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873" Jul 14 17:03:02.373652 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.373611 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873"} err="failed to get container status \"7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873\": rpc error: code = NotFound desc = could not find container \"7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873\": container with ID starting with 7e01052d0a0f5534bb3659eb9230c56c8e8942906554dfcd24201a008ed5b873 not found: ID does not exist" Jul 14 17:03:02.395741 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.395701 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx"] Jul 14 17:03:02.398848 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.398814 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3a7c08/test-model-3a7c08-kserve-55f5cfc49-hrpgx"] Jul 14 17:03:02.837761 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:02.837721 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" path="/var/lib/kubelet/pods/d7f62e4e-dc3f-49e8-a917-2368d9b2ffca/volumes" Jul 14 17:03:11.896729 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:11.896675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:12.001193 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:12.001160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:30.865900 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:30.865858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:31.193666 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:31.193571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:31.472287 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:31.472194 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:31.745066 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:31.745032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:32.252814 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:32.252750 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:32.551006 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:32.550922 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:32.678751 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:32.678719 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:33.001814 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:33.001781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:35.232224 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:35.232185 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:03:39.345563 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:39.345526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:39.439266 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:39.439233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:39.658913 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:39.658819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:39.923376 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:39.923284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:40.296215 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:40.296182 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:40.715422 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:40.715314 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:41.020897 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:41.020867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:44.017329 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:44.017286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:44.138579 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:44.138548 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:44.249299 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:44.249263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:44.413493 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:44.413360 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:44.933273 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:44.933234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:45.104327 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:45.104289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:47.934352 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:47.934308 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:03:48.534470 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:48.534430 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:49.063316 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:49.063274 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:49.484053 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:49.484015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:49.780023 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:49.779930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:53.058337 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:53.058301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:53.298688 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:53.298649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:53.426159 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:53.426066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:53.597398 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:53.597359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:54.228370 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:54.228334 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:54.372748 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:54.372685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:57.516752 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:57.516714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:03:58.837678 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:03:58.837650 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:04:06.022810 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:06.022767 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:06.161819 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:06.161787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:06.599327 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:06.599252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:06.990770 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:06.990736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:07.177692 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:07.177653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:10.229595 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:10.229557 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:04:14.580105 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:14.580065 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:16.163576 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:16.163537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:23.841575 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:23.841531 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:04:24.553918 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:24.553882 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:24.684254 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:24.684217 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:24.897527 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:24.897440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:25.099190 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:25.099150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:25.480386 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:25.480353 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:25.890611 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:25.890489 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:26.000124 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:26.000088 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:29.375664 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:29.375632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:29.548019 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:29.547978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:30.160236 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:30.160199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:30.558120 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:30.558085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:30.908957 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:30.908811 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:33.732760 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:33.732725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:33.932715 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:33.932674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:04:34.097969 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:34.097861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:34.583891 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:34.583850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:35.148795 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:35.148761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:38.267955 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:38.267912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:38.430181 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:38.430128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:38.550461 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:38.550344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:38.702309 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:38.702272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:39.383134 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:39.383101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:39.508452 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:39.508388 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:42.676808 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:42.676711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:44.862778 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:44.862744 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 17:04:44.869888 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:44.869857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 17:04:44.875398 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:44.875367 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 17:04:44.882350 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:44.882324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 17:04:45.818777 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:45.818734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:04:48.515972 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:48.515937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:51.815099 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:51.815060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:53.235774 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:53.235739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:04:58.508652 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:04:58.508615 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:05:01.766793 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:01.766751 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:05:01.886005 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:01.885852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:05:19.479273 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:19.479230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:05:31.818430 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.818361 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s"] Jul 14 17:05:31.818994 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.818976 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" containerName="main" Jul 14 17:05:31.819043 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.818998 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" containerName="main" Jul 14 17:05:31.819105 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.819094 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f62e4e-dc3f-49e8-a917-2368d9b2ffca" containerName="main" Jul 14 17:05:31.822448 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.822424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.826621 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.826590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"kube-root-ca.crt\"" Jul 14 17:05:31.828078 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.828054 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"default-dockercfg-t7g2r\"" Jul 14 17:05:31.828078 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.828072 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"openshift-service-ca.crt\"" Jul 14 17:05:31.828268 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.828120 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"auth-test-model-21db6d-kserve-self-signed-certs\"" Jul 14 17:05:31.837248 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.837209 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s"] Jul 14 17:05:31.867335 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.867284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:05:31.894434 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.894369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-home\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.894624 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.894461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8vcf\" (UniqueName: \"kubernetes.io/projected/6ac1ab44-c652-494d-aa7f-50d29e38c318-kube-api-access-r8vcf\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.894624 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.894514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac1ab44-c652-494d-aa7f-50d29e38c318-tls-certs\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.894624 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.894546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-model-cache\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.894624 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.894574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-dshm\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.894848 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.894680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-tmp-dir\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995460 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-home\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995676 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8vcf\" (UniqueName: \"kubernetes.io/projected/6ac1ab44-c652-494d-aa7f-50d29e38c318-kube-api-access-r8vcf\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995676 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac1ab44-c652-494d-aa7f-50d29e38c318-tls-certs\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995676 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-model-cache\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995676 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-dshm\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995676 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-tmp-dir\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995989 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-home\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995989 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-tmp-dir\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.995989 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.995972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-model-cache\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.997914 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.997893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-dshm\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:31.998179 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:31.998160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac1ab44-c652-494d-aa7f-50d29e38c318-tls-certs\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:32.008452 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:32.008416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8vcf\" (UniqueName: \"kubernetes.io/projected/6ac1ab44-c652-494d-aa7f-50d29e38c318-kube-api-access-r8vcf\") pod \"auth-test-model-21db6d-kserve-567578499-6r28s\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:32.132957 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:32.132849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:32.304682 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:32.304653 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s"] Jul 14 17:05:32.307554 ip-10-0-138-95 kubenswrapper[2576]: W0714 17:05:32.307523 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ac1ab44_c652_494d_aa7f_50d29e38c318.slice/crio-b8fcfb7bbdbfb48e18ca3660c4be6645940acf2d1e3a2b5bc865b036de456ca3 WatchSource:0}: Error finding container b8fcfb7bbdbfb48e18ca3660c4be6645940acf2d1e3a2b5bc865b036de456ca3: Status 404 returned error can't find the container with id b8fcfb7bbdbfb48e18ca3660c4be6645940acf2d1e3a2b5bc865b036de456ca3 Jul 14 17:05:33.116015 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:33.115977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" event={"ID":"6ac1ab44-c652-494d-aa7f-50d29e38c318","Type":"ContainerStarted","Data":"ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b"} Jul 14 17:05:33.116015 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:33.116020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" event={"ID":"6ac1ab44-c652-494d-aa7f-50d29e38c318","Type":"ContainerStarted","Data":"b8fcfb7bbdbfb48e18ca3660c4be6645940acf2d1e3a2b5bc865b036de456ca3"} Jul 14 17:05:33.145732 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:33.145635 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" podStartSLOduration=2.145612862 podStartE2EDuration="2.145612862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:05:33.143683586 +0000 UTC m=+2148.874057104" watchObservedRunningTime="2026-07-14 17:05:33.145612862 +0000 UTC m=+2148.875986360" Jul 14 17:05:35.148267 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:35.148221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:05:42.133792 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:42.133686 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:42.133792 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:42.133753 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:42.146679 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:42.146646 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:42.169051 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:42.169009 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:05:55.863378 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:55.863338 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:05:56.374521 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:56.374484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:05:58.007593 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:05:58.007558 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:06:05.330772 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:06:05.330724 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:06:23.222585 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:06:23.222543 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:06:35.849789 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:06:35.849755 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:06:52.123060 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:06:52.123021 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:07:02.126038 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:02.126001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:07:09.068156 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:09.068062 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:07:26.455862 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:26.455816 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:07:40.140167 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:40.140130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:07:45.002165 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:45.002129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:07:45.868450 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:45.868387 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s"] Jul 14 17:07:46.075305 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:46.075269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:07:54.522625 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:54.522583 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:07:57.812670 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:07:57.812635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:08:00.891465 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:00.891360 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" podUID="6ac1ab44-c652-494d-aa7f-50d29e38c318" containerName="main" containerID="cri-o://ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b" gracePeriod=45 Jul 14 17:08:01.146006 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.145929 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:08:01.225961 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.225920 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-home\") pod \"6ac1ab44-c652-494d-aa7f-50d29e38c318\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " Jul 14 17:08:01.226164 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226007 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-model-cache\") pod \"6ac1ab44-c652-494d-aa7f-50d29e38c318\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " Jul 14 17:08:01.226164 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226034 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-dshm\") pod \"6ac1ab44-c652-494d-aa7f-50d29e38c318\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " Jul 14 17:08:01.226164 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226078 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-tmp-dir\") pod \"6ac1ab44-c652-494d-aa7f-50d29e38c318\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " Jul 14 17:08:01.226329 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226178 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8vcf\" (UniqueName: \"kubernetes.io/projected/6ac1ab44-c652-494d-aa7f-50d29e38c318-kube-api-access-r8vcf\") pod \"6ac1ab44-c652-494d-aa7f-50d29e38c318\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " Jul 14 17:08:01.226329 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226212 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac1ab44-c652-494d-aa7f-50d29e38c318-tls-certs\") pod \"6ac1ab44-c652-494d-aa7f-50d29e38c318\" (UID: \"6ac1ab44-c652-494d-aa7f-50d29e38c318\") " Jul 14 17:08:01.226329 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226243 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-home" (OuterVolumeSpecName: "home") pod "6ac1ab44-c652-494d-aa7f-50d29e38c318" (UID: "6ac1ab44-c652-494d-aa7f-50d29e38c318"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:08:01.226329 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226263 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ac1ab44-c652-494d-aa7f-50d29e38c318" (UID: "6ac1ab44-c652-494d-aa7f-50d29e38c318"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:08:01.226579 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226397 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ac1ab44-c652-494d-aa7f-50d29e38c318" (UID: "6ac1ab44-c652-494d-aa7f-50d29e38c318"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:08:01.226579 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226564 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-home\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:08:01.226678 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226586 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-model-cache\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:08:01.226678 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.226603 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-tmp-dir\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:08:01.228456 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.228421 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-dshm" (OuterVolumeSpecName: "dshm") pod "6ac1ab44-c652-494d-aa7f-50d29e38c318" (UID: "6ac1ab44-c652-494d-aa7f-50d29e38c318"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:08:01.228557 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.228467 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ac1ab44-c652-494d-aa7f-50d29e38c318-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ac1ab44-c652-494d-aa7f-50d29e38c318" (UID: "6ac1ab44-c652-494d-aa7f-50d29e38c318"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:08:01.228600 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.228548 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac1ab44-c652-494d-aa7f-50d29e38c318-kube-api-access-r8vcf" (OuterVolumeSpecName: "kube-api-access-r8vcf") pod "6ac1ab44-c652-494d-aa7f-50d29e38c318" (UID: "6ac1ab44-c652-494d-aa7f-50d29e38c318"). InnerVolumeSpecName "kube-api-access-r8vcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:08:01.327245 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.327203 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ac1ab44-c652-494d-aa7f-50d29e38c318-dshm\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:08:01.327245 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.327240 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8vcf\" (UniqueName: \"kubernetes.io/projected/6ac1ab44-c652-494d-aa7f-50d29e38c318-kube-api-access-r8vcf\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:08:01.327482 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.327258 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ac1ab44-c652-494d-aa7f-50d29e38c318-tls-certs\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:08:01.838344 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.838309 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ac1ab44-c652-494d-aa7f-50d29e38c318" containerID="ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b" exitCode=0 Jul 14 17:08:01.838546 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.838354 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" Jul 14 17:08:01.838546 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.838392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" event={"ID":"6ac1ab44-c652-494d-aa7f-50d29e38c318","Type":"ContainerDied","Data":"ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b"} Jul 14 17:08:01.838546 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.838456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s" event={"ID":"6ac1ab44-c652-494d-aa7f-50d29e38c318","Type":"ContainerDied","Data":"b8fcfb7bbdbfb48e18ca3660c4be6645940acf2d1e3a2b5bc865b036de456ca3"} Jul 14 17:08:01.838546 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.838476 2576 scope.go:117] "RemoveContainer" containerID="ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b" Jul 14 17:08:01.847993 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.847973 2576 scope.go:117] "RemoveContainer" containerID="ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b" Jul 14 17:08:01.848336 ip-10-0-138-95 kubenswrapper[2576]: E0714 17:08:01.848316 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b\": container with ID starting with ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b not found: ID does not exist" containerID="ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b" Jul 14 17:08:01.848396 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.848346 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b"} err="failed to get container status \"ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b\": rpc error: code = NotFound desc = could not find container \"ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b\": container with ID starting with ea835a09aeebc56d722456ea24f11b566e66d591f19de482f170d2bab2c62f5b not found: ID does not exist" Jul 14 17:08:01.871417 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.871375 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s"] Jul 14 17:08:01.876796 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:01.876760 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/auth-test-model-21db6d-kserve-567578499-6r28s"] Jul 14 17:08:02.836974 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:02.836935 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ac1ab44-c652-494d-aa7f-50d29e38c318" path="/var/lib/kubelet/pods/6ac1ab44-c652-494d-aa7f-50d29e38c318/volumes" Jul 14 17:08:12.435251 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:12.435216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:08:12.531856 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:12.531816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:08:33.135120 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.135070 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq"] Jul 14 17:08:33.135772 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.135703 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac1ab44-c652-494d-aa7f-50d29e38c318" containerName="main" Jul 14 17:08:33.135772 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.135725 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac1ab44-c652-494d-aa7f-50d29e38c318" containerName="main" Jul 14 17:08:33.135858 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.135790 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac1ab44-c652-494d-aa7f-50d29e38c318" containerName="main" Jul 14 17:08:33.138734 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.138708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.143629 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.143604 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"default-dockercfg-t7g2r\"" Jul 14 17:08:33.145176 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.145152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"openshift-service-ca.crt\"" Jul 14 17:08:33.145305 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.145152 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"sub-test-model-21db6d-kserve-self-signed-certs\"" Jul 14 17:08:33.145305 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.145153 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"kube-root-ca.crt\"" Jul 14 17:08:33.154982 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.154948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq"] Jul 14 17:08:33.187200 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.187164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:08:33.215506 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.215459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-home\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.215690 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.215514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-model-cache\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.215690 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.215550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs2lj\" (UniqueName: \"kubernetes.io/projected/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-kube-api-access-hs2lj\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.215690 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.215596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-dshm\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.215690 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.215614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tls-certs\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.215825 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.215709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tmp-dir\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316083 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tmp-dir\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316083 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-home\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316342 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-model-cache\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316342 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs2lj\" (UniqueName: \"kubernetes.io/projected/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-kube-api-access-hs2lj\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316342 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-dshm\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316342 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tls-certs\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316628 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-home\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316682 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-model-cache\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.316682 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.316595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tmp-dir\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.318699 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.318671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-dshm\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.318971 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.318935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tls-certs\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.331699 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.331662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs2lj\" (UniqueName: \"kubernetes.io/projected/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-kube-api-access-hs2lj\") pod \"sub-test-model-21db6d-kserve-6486794885-flkfq\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.448978 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.448880 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:33.603940 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.603905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq"] Jul 14 17:08:33.606020 ip-10-0-138-95 kubenswrapper[2576]: W0714 17:08:33.605985 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7327251e_a3d1_4c7f_b7c2_f7f16accfbfe.slice/crio-3d742088377033a2c0564e1b8b46f320cde5a723a13709f8c464a53412e004b8 WatchSource:0}: Error finding container 3d742088377033a2c0564e1b8b46f320cde5a723a13709f8c464a53412e004b8: Status 404 returned error can't find the container with id 3d742088377033a2c0564e1b8b46f320cde5a723a13709f8c464a53412e004b8 Jul 14 17:08:33.996317 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.996277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" event={"ID":"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe","Type":"ContainerStarted","Data":"73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274"} Jul 14 17:08:33.996532 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:33.996327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" event={"ID":"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe","Type":"ContainerStarted","Data":"3d742088377033a2c0564e1b8b46f320cde5a723a13709f8c464a53412e004b8"} Jul 14 17:08:34.035185 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:34.035120 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" podStartSLOduration=1.035103433 podStartE2EDuration="1.035103433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:08:34.032999235 +0000 UTC m=+2329.763372753" watchObservedRunningTime="2026-07-14 17:08:34.035103433 +0000 UTC m=+2329.765476952" Jul 14 17:08:34.101715 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:34.101677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:08:36.972117 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:36.972028 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:08:43.449421 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:43.449357 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:43.449974 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:43.449448 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:43.462064 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:43.462023 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:44.055005 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:44.054975 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:08:56.520349 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:08:56.520304 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:09:09.310910 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:09.310861 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:09:22.191311 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:22.191252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:09:23.016390 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:23.016345 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq"] Jul 14 17:09:23.407072 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:23.406982 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:09:24.416916 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:24.416875 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:09:30.565464 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:30.565393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:09:38.037248 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.037199 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" podUID="7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" containerName="main" containerID="cri-o://73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274" gracePeriod=45 Jul 14 17:09:38.298086 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.298006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:09:38.310428 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.310361 2576 generic.go:356] "Generic (PLEG): container finished" podID="7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" containerID="73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274" exitCode=0 Jul 14 17:09:38.310428 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.310418 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" Jul 14 17:09:38.310625 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.310435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" event={"ID":"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe","Type":"ContainerDied","Data":"73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274"} Jul 14 17:09:38.310625 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.310473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq" event={"ID":"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe","Type":"ContainerDied","Data":"3d742088377033a2c0564e1b8b46f320cde5a723a13709f8c464a53412e004b8"} Jul 14 17:09:38.310625 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.310494 2576 scope.go:117] "RemoveContainer" containerID="73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274" Jul 14 17:09:38.319470 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.319446 2576 scope.go:117] "RemoveContainer" containerID="73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274" Jul 14 17:09:38.319847 ip-10-0-138-95 kubenswrapper[2576]: E0714 17:09:38.319823 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274\": container with ID starting with 73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274 not found: ID does not exist" containerID="73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274" Jul 14 17:09:38.319972 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.319878 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274"} err="failed to get container status \"73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274\": rpc error: code = NotFound desc = could not find container \"73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274\": container with ID starting with 73d2bcf842ca3b3e21b43b115f2f5c3bbdd0526d6a8bfd3efd2b6eae48d51274 not found: ID does not exist" Jul 14 17:09:38.427531 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427488 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-dshm\") pod \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " Jul 14 17:09:38.427531 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427535 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-model-cache\") pod \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " Jul 14 17:09:38.427767 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427577 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-home\") pod \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " Jul 14 17:09:38.427767 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427603 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tls-certs\") pod \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " Jul 14 17:09:38.427767 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427630 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs2lj\" (UniqueName: \"kubernetes.io/projected/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-kube-api-access-hs2lj\") pod \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " Jul 14 17:09:38.427767 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tmp-dir\") pod \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\" (UID: \"7327251e-a3d1-4c7f-b7c2-f7f16accfbfe\") " Jul 14 17:09:38.428138 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427911 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-model-cache" (OuterVolumeSpecName: "model-cache") pod "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" (UID: "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:09:38.428138 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.427982 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-home" (OuterVolumeSpecName: "home") pod "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" (UID: "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:09:38.428138 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.428001 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" (UID: "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:09:38.429807 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.429774 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-dshm" (OuterVolumeSpecName: "dshm") pod "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" (UID: "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:09:38.429908 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.429802 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" (UID: "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:09:38.429908 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.429820 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-kube-api-access-hs2lj" (OuterVolumeSpecName: "kube-api-access-hs2lj") pod "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" (UID: "7327251e-a3d1-4c7f-b7c2-f7f16accfbfe"). InnerVolumeSpecName "kube-api-access-hs2lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:09:38.529277 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.529230 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-dshm\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:09:38.529277 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.529272 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-model-cache\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:09:38.529277 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.529285 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-home\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:09:38.529605 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.529296 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tls-certs\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:09:38.529605 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.529309 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs2lj\" (UniqueName: \"kubernetes.io/projected/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-kube-api-access-hs2lj\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:09:38.529605 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.529345 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe-tmp-dir\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:09:38.638172 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.638134 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq"] Jul 14 17:09:38.642039 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.641981 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/sub-test-model-21db6d-kserve-6486794885-flkfq"] Jul 14 17:09:38.835886 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:38.835847 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" path="/var/lib/kubelet/pods/7327251e-a3d1-4c7f-b7c2-f7f16accfbfe/volumes" Jul 14 17:09:40.815092 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:40.815049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:09:44.891364 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:44.891332 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 17:09:44.898712 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:44.898680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 17:09:44.905151 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:44.905121 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 17:09:44.911220 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:44.911192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cn9dd_e5b37dcd-b10a-4b42-9ba1-b5ed6fd5f7c0/ovn-acl-logging/0.log" Jul 14 17:09:53.084523 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.084475 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:09:53.406850 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.406758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:09:53.728418 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.728301 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g"] Jul 14 17:09:53.728861 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.728836 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" containerName="main" Jul 14 17:09:53.728861 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.728862 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" containerName="main" Jul 14 17:09:53.729040 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.728939 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7327251e-a3d1-4c7f-b7c2-f7f16accfbfe" containerName="main" Jul 14 17:09:53.731930 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.731904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.736383 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.736356 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"openshift-service-ca.crt\"" Jul 14 17:09:53.737097 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.737078 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"default-dockercfg-t7g2r\"" Jul 14 17:09:53.737858 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.737840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"kube-root-ca.crt\"" Jul 14 17:09:53.738464 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.738448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21db6d\"/\"rate-test-model-21db6d-kserve-self-signed-certs\"" Jul 14 17:09:53.751193 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.751157 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g"] Jul 14 17:09:53.799515 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.799480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:09:53.883833 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.883791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-home\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.884010 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.883866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tjmm\" (UniqueName: \"kubernetes.io/projected/714c1f48-3cb4-4164-918e-ede316ffbec9-kube-api-access-9tjmm\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.884010 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.883903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-tmp-dir\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.884010 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.883974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-model-cache\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.884130 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.884029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-dshm\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.884130 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.884059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714c1f48-3cb4-4164-918e-ede316ffbec9-tls-certs\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985458 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-home\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985631 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjmm\" (UniqueName: \"kubernetes.io/projected/714c1f48-3cb4-4164-918e-ede316ffbec9-kube-api-access-9tjmm\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985631 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-tmp-dir\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985631 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-model-cache\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985795 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-dshm\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985795 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714c1f48-3cb4-4164-918e-ede316ffbec9-tls-certs\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985913 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-home\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.985977 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.985943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-tmp-dir\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.986042 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.986021 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-model-cache\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.988112 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.988084 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-dshm\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:53.988322 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:53.988306 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714c1f48-3cb4-4164-918e-ede316ffbec9-tls-certs\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:54.003047 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:54.003007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjmm\" (UniqueName: \"kubernetes.io/projected/714c1f48-3cb4-4164-918e-ede316ffbec9-kube-api-access-9tjmm\") pod \"rate-test-model-21db6d-kserve-f5cdbd859-zw99g\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:54.042536 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:54.042496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:09:54.196370 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:54.196341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g"] Jul 14 17:09:54.199178 ip-10-0-138-95 kubenswrapper[2576]: W0714 17:09:54.199146 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod714c1f48_3cb4_4164_918e_ede316ffbec9.slice/crio-1e675da8d8cb8dbbd855cbfb81a0b01e2d13812b5316c41c5c342465cf8f95b5 WatchSource:0}: Error finding container 1e675da8d8cb8dbbd855cbfb81a0b01e2d13812b5316c41c5c342465cf8f95b5: Status 404 returned error can't find the container with id 1e675da8d8cb8dbbd855cbfb81a0b01e2d13812b5316c41c5c342465cf8f95b5 Jul 14 17:09:54.396625 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:54.396584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" event={"ID":"714c1f48-3cb4-4164-918e-ede316ffbec9","Type":"ContainerStarted","Data":"9f288471db650ce2bb92586337b0542993d8b84ba8dbdf87dd47f20b7e51d8e1"} Jul 14 17:09:54.396625 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:54.396627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" event={"ID":"714c1f48-3cb4-4164-918e-ede316ffbec9","Type":"ContainerStarted","Data":"1e675da8d8cb8dbbd855cbfb81a0b01e2d13812b5316c41c5c342465cf8f95b5"} Jul 14 17:09:54.427587 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:54.427526 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" podStartSLOduration=1.427507621 podStartE2EDuration="1.427507621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:09:54.426299379 +0000 UTC m=+2410.156672898" watchObservedRunningTime="2026-07-14 17:09:54.427507621 +0000 UTC m=+2410.157881194" Jul 14 17:09:58.212838 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:09:58.212787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:10:03.091390 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:03.091352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:03.329001 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:03.328960 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:04.043745 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:04.043695 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:10:04.043745 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:04.043749 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:10:04.056429 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:04.056383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:10:04.456078 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:04.455987 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:10:10.658512 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:10.658427 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:10:29.087988 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:29.087953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:10:33.516795 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:33.516756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:34.404577 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:34.404533 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g"] Jul 14 17:10:34.441631 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:34.441590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:35.565723 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:35.565686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:35.965844 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:35.965755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:36.151014 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:36.150981 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:36.257793 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:36.257764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:36.504151 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:36.504110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:39.509676 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:39.509640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:10:41.032199 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:41.032164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:10:49.425091 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.425038 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" podUID="714c1f48-3cb4-4164-918e-ede316ffbec9" containerName="main" containerID="cri-o://9f288471db650ce2bb92586337b0542993d8b84ba8dbdf87dd47f20b7e51d8e1" gracePeriod=45 Jul 14 17:10:49.666905 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.666876 2576 generic.go:356] "Generic (PLEG): container finished" podID="714c1f48-3cb4-4164-918e-ede316ffbec9" containerID="9f288471db650ce2bb92586337b0542993d8b84ba8dbdf87dd47f20b7e51d8e1" exitCode=0 Jul 14 17:10:49.666999 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.666951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" event={"ID":"714c1f48-3cb4-4164-918e-ede316ffbec9","Type":"ContainerDied","Data":"9f288471db650ce2bb92586337b0542993d8b84ba8dbdf87dd47f20b7e51d8e1"} Jul 14 17:10:49.667056 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.666996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" event={"ID":"714c1f48-3cb4-4164-918e-ede316ffbec9","Type":"ContainerDied","Data":"1e675da8d8cb8dbbd855cbfb81a0b01e2d13812b5316c41c5c342465cf8f95b5"} Jul 14 17:10:49.667056 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.667012 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e675da8d8cb8dbbd855cbfb81a0b01e2d13812b5316c41c5c342465cf8f95b5" Jul 14 17:10:49.676495 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.676443 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:10:49.780545 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780489 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-tmp-dir\") pod \"714c1f48-3cb4-4164-918e-ede316ffbec9\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " Jul 14 17:10:49.780731 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780566 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-model-cache\") pod \"714c1f48-3cb4-4164-918e-ede316ffbec9\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " Jul 14 17:10:49.780731 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780597 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-dshm\") pod \"714c1f48-3cb4-4164-918e-ede316ffbec9\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " Jul 14 17:10:49.780731 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780642 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-home\") pod \"714c1f48-3cb4-4164-918e-ede316ffbec9\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " Jul 14 17:10:49.780731 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780674 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tjmm\" (UniqueName: \"kubernetes.io/projected/714c1f48-3cb4-4164-918e-ede316ffbec9-kube-api-access-9tjmm\") pod \"714c1f48-3cb4-4164-918e-ede316ffbec9\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " Jul 14 17:10:49.780731 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780697 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714c1f48-3cb4-4164-918e-ede316ffbec9-tls-certs\") pod \"714c1f48-3cb4-4164-918e-ede316ffbec9\" (UID: \"714c1f48-3cb4-4164-918e-ede316ffbec9\") " Jul 14 17:10:49.781001 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780838 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "714c1f48-3cb4-4164-918e-ede316ffbec9" (UID: "714c1f48-3cb4-4164-918e-ede316ffbec9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:10:49.781001 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780857 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-model-cache" (OuterVolumeSpecName: "model-cache") pod "714c1f48-3cb4-4164-918e-ede316ffbec9" (UID: "714c1f48-3cb4-4164-918e-ede316ffbec9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:10:49.781001 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.780914 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-home" (OuterVolumeSpecName: "home") pod "714c1f48-3cb4-4164-918e-ede316ffbec9" (UID: "714c1f48-3cb4-4164-918e-ede316ffbec9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:10:49.781145 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.781056 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-tmp-dir\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:10:49.781145 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.781070 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-model-cache\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:10:49.781145 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.781079 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-home\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:10:49.782760 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.782734 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/714c1f48-3cb4-4164-918e-ede316ffbec9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "714c1f48-3cb4-4164-918e-ede316ffbec9" (UID: "714c1f48-3cb4-4164-918e-ede316ffbec9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 17:10:49.782838 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.782814 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-dshm" (OuterVolumeSpecName: "dshm") pod "714c1f48-3cb4-4164-918e-ede316ffbec9" (UID: "714c1f48-3cb4-4164-918e-ede316ffbec9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 17:10:49.782881 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.782851 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/714c1f48-3cb4-4164-918e-ede316ffbec9-kube-api-access-9tjmm" (OuterVolumeSpecName: "kube-api-access-9tjmm") pod "714c1f48-3cb4-4164-918e-ede316ffbec9" (UID: "714c1f48-3cb4-4164-918e-ede316ffbec9"). InnerVolumeSpecName "kube-api-access-9tjmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 17:10:49.881657 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.881608 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714c1f48-3cb4-4164-918e-ede316ffbec9-dshm\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:10:49.881657 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.881651 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tjmm\" (UniqueName: \"kubernetes.io/projected/714c1f48-3cb4-4164-918e-ede316ffbec9-kube-api-access-9tjmm\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:10:49.881657 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:49.881662 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714c1f48-3cb4-4164-918e-ede316ffbec9-tls-certs\") on node \"ip-10-0-138-95.ec2.internal\" DevicePath \"\"" Jul 14 17:10:50.674449 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:50.674418 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g" Jul 14 17:10:50.704294 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:50.704257 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g"] Jul 14 17:10:50.715953 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:50.715914 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-21db6d/rate-test-model-21db6d-kserve-f5cdbd859-zw99g"] Jul 14 17:10:50.835288 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:10:50.835255 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="714c1f48-3cb4-4164-918e-ede316ffbec9" path="/var/lib/kubelet/pods/714c1f48-3cb4-4164-918e-ede316ffbec9/volumes" Jul 14 17:11:17.749896 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:17.749864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:18.148820 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:18.148730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:18.392368 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:18.392299 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:18.686834 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:18.686801 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:19.155618 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:19.155579 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:19.506059 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:19.506026 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:19.621822 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:19.621777 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:19.874267 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:19.874173 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:20.521268 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:20.521228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:24.360829 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:24.360788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ltf7d"] Jul 14 17:11:26.920956 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:26.920920 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:27.041899 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:27.041868 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:27.228925 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:27.228838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:27.631435 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:27.631374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:34.496026 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:34.495996 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-759st_0f5e7327-19af-44a0-8b67-291d32f90c07/copy-manifests/0.log" Jul 14 17:11:34.529340 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:34.529315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-759st_0f5e7327-19af-44a0-8b67-291d32f90c07/manager/0.log" Jul 14 17:11:37.243101 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:37.243031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ltf7d_90ee21b5-9ebe-4ac8-91b0-9b478754c224/limitador/0.log" Jul 14 17:11:37.892989 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:37.892962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-57hcl_beadfa32-20ef-4960-aab9-c36b84272307/discovery/0.log" Jul 14 17:11:38.702256 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:38.702225 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7c99c78d-j4xhp_fa89f02a-149d-4402-9298-107d463f876f/router/0.log" Jul 14 17:11:39.253893 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:39.253860 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-l4rxr_a3ba143d-59fa-4f45-918b-d518a1087f0f/main/0.log" Jul 14 17:11:39.644044 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:39.643952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qrzt2_5f2e9adf-de15-4e16-b331-91911ad0dcd7/main/0.log" Jul 14 17:11:39.770815 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:39.770781 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-js984_64adf9dd-5132-4940-94c4-21ee904bc0cd/main/0.log" Jul 14 17:11:44.744744 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:44.744709 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:44.866851 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:44.866805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:47.277702 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:47.277663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6b9q2_812e6e44-bd4f-4ca7-b4af-6892f3ecdb0c/global-pull-secret-syncer/0.log" Jul 14 17:11:47.510211 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:47.510172 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" Jul 14 17:11:47.717626 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:47.717538 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-95.ec2.internal_ed4b0f6053d8c96954c236175e72624a/haproxy/0.log" Jul 14 17:11:52.968987 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:52.968958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ltf7d_90ee21b5-9ebe-4ac8-91b0-9b478754c224/limitador/0.log" Jul 14 17:11:54.702234 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.702152 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/alertmanager/0.log" Jul 14 17:11:54.757211 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.757182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/config-reloader/0.log" Jul 14 17:11:54.806667 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.806636 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/kube-rbac-proxy-web/0.log" Jul 14 17:11:54.845138 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.845102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/kube-rbac-proxy/0.log" Jul 14 17:11:54.893298 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.893269 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/kube-rbac-proxy-metric/0.log" Jul 14 17:11:54.930804 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.930775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/prom-label-proxy/0.log" Jul 14 17:11:54.965584 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:54.965492 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9080d7f7-51f4-4281-b2c1-b7e9865af588/init-config-reloader/0.log" Jul 14 17:11:55.015958 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.015912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-zfc5x_9c8f795f-c8cd-4f69-a876-e9f5a114b58d/cluster-monitoring-operator/0.log" Jul 14 17:11:55.067031 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.067000 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-78mvp_1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d/kube-state-metrics/0.log" Jul 14 17:11:55.121045 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.121010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-78mvp_1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d/kube-rbac-proxy-main/0.log" Jul 14 17:11:55.163292 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.163266 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-78mvp_1a7b6e9c-2c76-46c9-9ddd-0b4e52d25d3d/kube-rbac-proxy-self/0.log" Jul 14 17:11:55.262556 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.262531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-qwtg2_59ee894a-3077-4381-b368-291e9500e490/monitoring-plugin/0.log" Jul 14 17:11:55.324814 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.324783 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dkdq_9007891d-d1d0-4497-b081-c103a001d8b0/node-exporter/0.log" Jul 14 17:11:55.364624 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.364594 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dkdq_9007891d-d1d0-4497-b081-c103a001d8b0/kube-rbac-proxy/0.log" Jul 14 17:11:55.399620 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.399595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6dkdq_9007891d-d1d0-4497-b081-c103a001d8b0/init-textfile/0.log" Jul 14 17:11:55.593120 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:55.593030 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdp5q_02167480-d684-4628-a070-ed8fd8f5f1a7/konnectivity-agent/0.log" limit=1024 Jul 14 17:11:56.784221 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.784180 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc"] Jul 14 17:11:56.784644 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.784576 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="714c1f48-3cb4-4164-918e-ede316ffbec9" containerName="main" Jul 14 17:11:56.784644 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.784588 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="714c1f48-3cb4-4164-918e-ede316ffbec9" containerName="main" Jul 14 17:11:56.784720 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.784652 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="714c1f48-3cb4-4164-918e-ede316ffbec9" containerName="main" Jul 14 17:11:56.787737 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.787721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.791117 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.791091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2qj6\"/\"default-dockercfg-d8lld\"" Jul 14 17:11:56.791273 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.791100 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2qj6\"/\"openshift-service-ca.crt\"" Jul 14 17:11:56.792283 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.792266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2qj6\"/\"kube-root-ca.crt\"" Jul 14 17:11:56.803215 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.803185 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc"] Jul 14 17:11:56.871774 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.871737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-proc\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.871963 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.871819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-sys\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.871963 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.871849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrvdg\" (UniqueName: \"kubernetes.io/projected/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-kube-api-access-jrvdg\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.871963 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.871870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-podres\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.871963 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.871913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-lib-modules\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973034 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.972992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrvdg\" (UniqueName: \"kubernetes.io/projected/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-kube-api-access-jrvdg\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973233 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-podres\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973233 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-lib-modules\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973233 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-proc\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973233 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-sys\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973435 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-podres\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973435 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-sys\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973435 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973260 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-lib-modules\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.973435 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.973296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-proc\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:56.983656 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:56.983631 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrvdg\" (UniqueName: \"kubernetes.io/projected/5b9632c5-22c4-4633-a914-9ffeeebbbf1f-kube-api-access-jrvdg\") pod \"perf-node-gather-daemonset-j24pc\" (UID: \"5b9632c5-22c4-4633-a914-9ffeeebbbf1f\") " pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:57.097950 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:57.097861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:57.239285 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:57.239255 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc"] Jul 14 17:11:57.241736 ip-10-0-138-95 kubenswrapper[2576]: W0714 17:11:57.241703 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b9632c5_22c4_4633_a914_9ffeeebbbf1f.slice/crio-2081a3f46ca4afecd684dcf106205451270c64f24d87d09c161bb27affb7644c WatchSource:0}: Error finding container 2081a3f46ca4afecd684dcf106205451270c64f24d87d09c161bb27affb7644c: Status 404 returned error can't find the container with id 2081a3f46ca4afecd684dcf106205451270c64f24d87d09c161bb27affb7644c Jul 14 17:11:57.990205 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:57.990164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" event={"ID":"5b9632c5-22c4-4633-a914-9ffeeebbbf1f","Type":"ContainerStarted","Data":"75d073cd37a98da92b19123153c0ab4e13d481b8ab042348bd71823b59ff295c"} Jul 14 17:11:57.990626 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:57.990221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" event={"ID":"5b9632c5-22c4-4633-a914-9ffeeebbbf1f","Type":"ContainerStarted","Data":"2081a3f46ca4afecd684dcf106205451270c64f24d87d09c161bb27affb7644c"} Jul 14 17:11:57.990626 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:57.990252 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:11:58.461702 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:58.461612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/1.log" Jul 14 17:11:58.467037 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:58.467013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xgcjz_a52d3a93-6f57-49bc-8975-79ef0918907a/console-operator/2.log" Jul 14 17:11:59.900339 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:11:59.900309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-vvr4x_3cfa9a63-81d5-408e-903d-0597b9588e97/volume-data-source-validator/0.log" Jul 14 17:12:01.168927 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:01.168898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-94mms_7818c2f5-46c7-4662-820b-051dff5254e4/dns/0.log" Jul 14 17:12:01.199388 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:01.199358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-94mms_7818c2f5-46c7-4662-820b-051dff5254e4/kube-rbac-proxy/0.log" Jul 14 17:12:01.421068 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:01.420988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7p78q_a812f567-b022-43f6-8a27-48285783308f/dns-node-resolver/0.log" Jul 14 17:12:02.116118 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:02.116085 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j87mj_6a6754fe-b1cf-4e6a-8c2f-bb596e8adb53/node-ca/0.log" Jul 14 17:12:03.443497 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:03.443466 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-57hcl_beadfa32-20ef-4960-aab9-c36b84272307/discovery/0.log" Jul 14 17:12:03.842145 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:03.842114 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7c99c78d-j4xhp_fa89f02a-149d-4402-9298-107d463f876f/router/0.log" Jul 14 17:12:04.005562 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:04.005535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" Jul 14 17:12:04.036823 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:04.036769 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2qj6/perf-node-gather-daemonset-j24pc" podStartSLOduration=8.036754131 podStartE2EDuration="8.036754131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:11:58.01804634 +0000 UTC m=+2533.748419858" watchObservedRunningTime="2026-07-14 17:12:04.036754131 +0000 UTC m=+2539.767127649" Jul 14 17:12:04.720178 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:04.720146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s429w_41a5459f-4641-41bc-9577-057bc555590f/serve-healthcheck-canary/0.log" Jul 14 17:12:05.435886 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:05.435848 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-d7m55_0eb95d0c-006f-47b2-bb48-182ad2df3c57/insights-operator/0.log" Jul 14 17:12:05.436277 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:05.436259 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-d7m55_0eb95d0c-006f-47b2-bb48-182ad2df3c57/insights-operator/1.log" Jul 14 17:12:05.753751 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:05.753722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkzns_643fe84c-dff9-4186-b603-636ba30072ed/kube-rbac-proxy/0.log" Jul 14 17:12:05.786547 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:05.786522 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkzns_643fe84c-dff9-4186-b603-636ba30072ed/exporter/0.log" Jul 14 17:12:05.824816 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:05.824789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkzns_643fe84c-dff9-4186-b603-636ba30072ed/extractor/0.log" Jul 14 17:12:07.552741 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:07.552708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-57hcl_beadfa32-20ef-4960-aab9-c36b84272307/discovery/0.log" Jul 14 17:12:07.778520 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:07.778490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7c99c78d-j4xhp_fa89f02a-149d-4402-9298-107d463f876f/router/0.log" Jul 14 17:12:09.094568 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:09.094531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-57hcl_beadfa32-20ef-4960-aab9-c36b84272307/discovery/0.log" Jul 14 17:12:09.403836 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:09.403748 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-759st_0f5e7327-19af-44a0-8b67-291d32f90c07/manager/0.log" Jul 14 17:12:09.404088 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:09.404073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f7c99c78d-j4xhp_fa89f02a-149d-4402-9298-107d463f876f/router/0.log" Jul 14 17:12:09.440919 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:09.440889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8dbf5fbb-759st_0f5e7327-19af-44a0-8b67-291d32f90c07/copy-manifests/0.log" Jul 14 17:12:11.188763 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:11.188724 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7889f65889-v2q26_e23dfe28-b3cf-4bc8-a274-d4aee97c32ee/manager/0.log" Jul 14 17:12:11.222322 ip-10-0-138-95 kubenswrapper[2576]: I0714 17:12:11.222272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7t5mr_5875ab76-bff6-4ae0-9dab-3df307f02560/openshift-lws-operator/0.log"