Jul 16 00:42:14.956257 ip-10-0-138-126 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 00:42:14.956269 ip-10-0-138-126 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 00:42:14.956279 ip-10-0-138-126 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 00:42:14.956608 ip-10-0-138-126 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 00:42:25.180008 ip-10-0-138-126 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 00:42:25.180029 ip-10-0-138-126 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3f44ddb83245425f9c43ab53dee03366 -- Jul 16 00:44:22.692685 ip-10-0-138-126 systemd[1]: Starting Kubernetes Kubelet... Jul 16 00:44:23.181187 ip-10-0-138-126 systemd[1]: Started Kubernetes Kubelet. Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.108759 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112242 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112254 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112257 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112260 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112263 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112266 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112269 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:23.189369 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112272 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112274 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112277 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112280 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112283 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112285 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112291 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112294 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112296 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112299 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112302 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112304 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112308 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112312 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112315 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112318 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112321 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112323 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112326 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:23.190995 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112329 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112332 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112334 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112337 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112339 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112342 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112345 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112347 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112350 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112353 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112355 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112358 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112360 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112362 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112365 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112368 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112370 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112373 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112375 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112378 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:23.191851 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112381 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112384 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112386 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112389 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112406 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112410 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112412 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112415 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112418 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112423 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112426 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112430 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112433 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112436 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112439 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112441 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112444 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112447 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112450 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:23.193129 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112453 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112456 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112458 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112461 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112464 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112468 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112472 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112475 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112478 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112480 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112483 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112486 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112488 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112491 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112495 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112498 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112500 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112502 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112505 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112508 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:23.197445 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112510 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112513 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112515 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112518 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112520 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112523 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112525 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112528 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112531 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112535 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112537 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112540 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112543 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.112545 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114018 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114025 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114028 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114031 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114034 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114037 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:23.198652 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114040 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114043 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114046 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114049 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114052 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114054 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114057 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114060 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114063 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114066 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114068 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114071 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114073 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114076 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114078 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114081 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114084 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114087 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114091 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114094 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:23.199728 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114098 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114101 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114103 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114106 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114109 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114112 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114115 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114117 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114120 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114122 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114125 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114128 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114130 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114135 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114138 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114141 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114145 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114148 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114150 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:23.201224 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114158 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114161 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114164 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114167 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114170 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114173 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114175 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114178 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114181 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114184 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114186 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114189 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114191 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114194 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114205 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114208 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114210 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114213 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114218 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114222 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:23.202085 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114225 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114227 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114230 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114233 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114236 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114239 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114242 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114244 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114247 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114249 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114252 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114255 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114257 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114260 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114262 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114265 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114268 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114271 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114274 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114276 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:23.202940 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114279 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114281 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114284 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114286 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114289 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114291 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114293 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114296 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114299 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114301 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114304 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114306 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114309 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114311 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114679 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114684 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114687 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114690 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114694 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:23.204853 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114698 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114701 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114704 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114707 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114710 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114713 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114716 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114718 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114721 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114724 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114727 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114730 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114733 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114736 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114738 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114741 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114744 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114746 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114749 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114752 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:23.205719 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114754 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114757 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114760 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114763 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114766 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114769 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114771 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114774 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114776 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114779 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114781 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114784 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114787 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114790 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114792 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114795 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114798 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114800 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114803 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114806 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:23.207200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114809 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114811 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114814 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114817 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114819 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114822 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114825 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114827 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114834 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114837 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114840 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114843 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114846 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114848 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114851 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114853 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114857 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114860 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114862 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114865 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:23.208050 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114868 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114870 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114873 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114876 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114878 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114881 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114883 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114886 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114889 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114891 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114894 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114897 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114900 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114903 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114907 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114909 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114912 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114915 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114917 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:23.209744 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114920 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114924 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114927 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114929 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114932 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114934 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114937 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114939 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114942 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114944 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114947 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114950 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114952 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114955 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.114957 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115023 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115030 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115038 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115046 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115053 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115058 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 00:44:23.210638 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115063 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115067 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115071 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115074 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115078 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115082 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115085 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115088 2573 flags.go:64] FLAG: --cgroup-root="" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115090 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115093 2573 flags.go:64] FLAG: --client-ca-file="" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115096 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115099 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115105 2573 flags.go:64] FLAG: --cluster-domain="" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115108 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115111 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115114 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115117 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115121 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115124 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115127 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115130 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115133 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115136 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115143 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 00:44:23.211522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115146 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115149 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115153 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115156 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115158 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115161 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115164 2573 flags.go:64] FLAG: --enable-server="true" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115167 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115171 2573 flags.go:64] FLAG: --event-burst="100" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115174 2573 flags.go:64] FLAG: --event-qps="50" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115177 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115179 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115182 2573 flags.go:64] FLAG: --eviction-hard="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115186 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115189 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115192 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115195 2573 flags.go:64] FLAG: --eviction-soft="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115198 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115201 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115203 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115208 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115210 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115213 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115216 2573 flags.go:64] FLAG: --feature-gates="" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115220 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 00:44:23.212628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115222 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115225 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115228 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115231 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115234 2573 flags.go:64] FLAG: --help="false" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115237 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115241 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115244 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115247 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115250 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115254 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115256 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115259 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115262 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115265 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115268 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115271 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115273 2573 flags.go:64] FLAG: --kube-reserved="" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115276 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115279 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115282 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115284 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115291 2573 flags.go:64] FLAG: --lock-file="" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115294 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 00:44:23.213713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115297 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115300 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115305 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115309 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115312 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115315 2573 flags.go:64] FLAG: --logging-format="text" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115318 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115321 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115324 2573 flags.go:64] FLAG: --manifest-url="" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115327 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115331 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115334 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115338 2573 flags.go:64] FLAG: --max-pods="110" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115340 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115344 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115348 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115351 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115353 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115356 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115359 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115366 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115369 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115372 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 00:44:23.214794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115375 2573 flags.go:64] FLAG: --pod-cidr="" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115379 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115384 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115387 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115390 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115406 2573 flags.go:64] FLAG: --port="10250" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115410 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115413 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d535e09db85d32bb" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115417 2573 flags.go:64] FLAG: --qos-reserved="" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115420 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115423 2573 flags.go:64] FLAG: --register-node="true" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115426 2573 flags.go:64] FLAG: --register-with-taints="" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115429 2573 flags.go:64] FLAG: --registry-burst="10" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115434 2573 flags.go:64] FLAG: --registry-qps="5" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115437 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115440 2573 flags.go:64] FLAG: --reserved-memory="" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115443 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115446 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115449 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115452 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115454 2573 flags.go:64] FLAG: --runonce="false" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115457 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115460 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115464 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115467 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 00:44:23.215877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115470 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115473 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115476 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115479 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115482 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115485 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115487 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115490 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115493 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115496 2573 flags.go:64] FLAG: --system-cgroups="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115499 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115504 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115507 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115510 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115514 2573 flags.go:64] FLAG: --tls-min-version="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115517 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115520 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115523 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115526 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115529 2573 flags.go:64] FLAG: --v="2" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115534 2573 flags.go:64] FLAG: --version="false" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115537 2573 flags.go:64] FLAG: --vmodule="" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115541 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.115544 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115672 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:23.314322 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115676 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115679 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115682 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115685 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115688 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115693 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115696 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115699 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115702 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115705 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115708 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115710 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115713 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115716 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115718 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115721 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115723 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115726 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115728 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115731 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:23.315523 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115734 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115736 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115739 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115741 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115744 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115747 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115750 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115754 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115757 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115759 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115762 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115764 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115767 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115770 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115772 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115775 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115777 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115781 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115784 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115786 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:23.316350 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115789 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115791 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115794 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115796 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115799 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115801 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115805 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115809 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115811 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115814 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115817 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115820 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115823 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115827 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115830 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115833 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115836 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115839 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115841 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:23.317063 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115845 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115848 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115850 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115853 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115856 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115858 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115861 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115863 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115866 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115869 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115872 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115875 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115877 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115880 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115883 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115885 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115888 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115890 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115893 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:23.317732 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115895 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115899 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115902 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115905 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115907 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115910 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115912 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115915 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115917 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115920 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115922 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115925 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115928 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115932 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115934 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115937 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115939 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115942 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115944 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:23.321032 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.115947 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.116576 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.124300 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.124315 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.125242 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.125249 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125305 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125310 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125313 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125317 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125320 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125322 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125325 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125330 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125333 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:23.341961 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125335 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125338 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125341 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125344 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125347 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125349 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125352 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125355 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125357 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125360 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125363 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125365 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125368 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125371 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125373 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125376 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125379 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125382 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125385 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125387 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:23.344059 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125391 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125407 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125411 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125414 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125416 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125419 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125422 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125424 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125427 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125431 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125437 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125440 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125443 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125446 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125449 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125451 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125454 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125457 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125460 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:23.345012 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125463 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125465 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125468 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125471 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125473 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125477 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125480 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125483 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125486 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125491 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125495 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125499 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125502 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125505 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125507 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125510 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125512 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125515 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125518 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:23.346446 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125520 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125523 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125525 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125528 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125532 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125535 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125538 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125540 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125543 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125545 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125548 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125551 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125559 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125562 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125565 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125568 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125570 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125573 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125576 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125578 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:23.347840 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125581 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125584 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125587 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125590 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125592 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125595 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125598 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125600 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125603 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125605 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125608 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125610 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.125615 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125726 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125732 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:44:23.349007 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125735 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125738 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125744 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125747 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125751 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125755 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125758 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125760 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125763 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125766 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125769 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125772 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125776 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125780 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125783 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125786 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125789 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125791 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125794 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:44:23.349925 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125798 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125801 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125804 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125806 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125809 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125812 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125814 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125817 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125819 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125822 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125824 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125826 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125829 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125831 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125834 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125839 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125842 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125844 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125847 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125849 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:44:23.350852 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125852 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125854 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125857 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125860 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125865 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125867 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125870 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125872 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125875 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125878 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125880 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125883 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125887 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125890 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125892 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125894 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125897 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125900 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125903 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:44:23.352510 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125907 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125910 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125912 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125915 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125918 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125921 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125924 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125927 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125931 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125934 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125937 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125939 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125942 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125944 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125947 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125950 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125952 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125955 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125959 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125962 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:44:23.353441 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125964 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125967 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125969 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125972 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125974 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125978 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125981 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125983 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125985 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125988 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125990 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125993 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125995 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.125998 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.126001 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.126003 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.126006 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.126008 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:44:23.354365 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:23.126011 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.126016 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.126111 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.128131 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.129613 2573 server.go:1019] "Starting client certificate rotation" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.129719 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.129754 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.132251 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.133789 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.145974 2573 log.go:25] "Validated CRI v1 runtime API" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.148740 2573 log.go:25] "Validated CRI v1 image API" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.149543 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 00:44:23.355308 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.154436 2573 fs.go:135] Filesystem UUIDs: map[095a46e3-cbea-4f78-832e-0877658309a6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8121bb34-cf93-49e7-9b54-43ba493ff8f2:/dev/nvme0n1p4] Jul 16 00:44:23.356453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.154455 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 00:44:23.356453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.158267 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.161662 2573 manager.go:216] Machine: {Timestamp:2026-07-16 00:44:23.159860166 +0000 UTC m=+0.351305697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100221 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c68869566b131474e58cf739faa18 SystemUUID:ec2c6886-9566-b131-474e-58cf739faa18 BootID:3f44ddb8-3245-425f-9c43-ab53dee03366 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:f6:ad:de:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:f6:ad:de:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f8:97:36:35:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.161784 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.161906 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.164654 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.164677 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.165386 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.165410 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.165418 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.166864 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.167640 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.170860 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.170967 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.170992 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.171000 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.171015 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.171023 2573 kubelet.go:398] "Adding apiserver pod source" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.171031 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 00:44:23.357394 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.171368 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.171384 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.173880 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.175507 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.175535 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176143 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176157 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176163 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176168 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176197 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176206 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176284 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176290 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176296 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176302 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176319 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.176327 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.177063 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.177071 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.180292 2573 server.go:1268] "Started kubelet" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.180367 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.180588 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.180683 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.182047 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.182194 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.182284 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.182373 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.183114 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.185660 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-grbx9" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.187568 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-126.ec2.internal.18c29e7d405ff4cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-126.ec2.internal,UID:ip-10-0-138-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-126.ec2.internal,},FirstTimestamp:2026-07-16 00:44:23.180268748 +0000 UTC m=+0.371714277,LastTimestamp:2026-07-16 00:44:23.180268748 +0000 UTC m=+0.371714277,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-126.ec2.internal,}" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.189051 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.189368 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.210061 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.210572 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-grbx9" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.210832 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.212414 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.212433 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.212743 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.212755 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.220533 2573 factory.go:55] Registering systemd factory Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.220549 2573 factory.go:223] Registration of the systemd container factory successfully Jul 16 00:44:23.358322 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.221181 2573 factory.go:153] Registering CRI-O factory Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.221206 2573 factory.go:223] Registration of the crio container factory successfully Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.221260 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.221307 2573 factory.go:103] Registering Raw factory Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.221322 2573 manager.go:1196] Started watching for new ooms in manager Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.221771 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.221874 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.222787 2573 manager.go:349] Starting recovery of all containers Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.223989 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.236898 2573 manager.go:354] Recovery completed Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.241452 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243125 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243149 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243161 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243819 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243832 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243852 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.243821 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.244876 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.244908 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.244923 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.245058 2573 policy_none.go:49] "None policy: Start" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.245073 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.245084 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.246011 2573 policy_none.go:47] "Start" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297017 2573 manager.go:337] "Starting Device Plugin manager" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.297199 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297213 2573 server.go:87] "Starting device plugin registration server" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297424 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297437 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297543 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297642 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.297651 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.298124 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 00:44:23.360862 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.298179 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.399429 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.405541 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.405574 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.405589 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.405618 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.419754 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.419774 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-126.ec2.internal\": node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.428356 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.429649 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.429690 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.429711 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.429744 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.432308 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.446013 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.530339 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal"] Jul 16 00:44:23.536026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.530416 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.537334 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.537148 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.537334 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.537175 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.537334 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.537185 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.539685 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.539803 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.539832 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.540434 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.540433 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.540483 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.540493 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.540457 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.540545 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.543004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.543028 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.543691 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.543717 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.543727 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.546298 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.562012 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-126.ec2.internal\" not found" node="ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.570612 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-126.ec2.internal\" not found" node="ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.614305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7143e0b2c8c4c8c27e7d0e8a114980a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal\" (UID: \"b7143e0b2c8c4c8c27e7d0e8a114980a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.614328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7143e0b2c8c4c8c27e7d0e8a114980a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal\" (UID: \"b7143e0b2c8c4c8c27e7d0e8a114980a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.614347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed51309d98dfb7011e0d41dbcc4027d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-126.ec2.internal\" (UID: \"2ed51309d98dfb7011e0d41dbcc4027d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.704959 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.646346 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.715877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7143e0b2c8c4c8c27e7d0e8a114980a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal\" (UID: \"b7143e0b2c8c4c8c27e7d0e8a114980a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.715898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7143e0b2c8c4c8c27e7d0e8a114980a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal\" (UID: \"b7143e0b2c8c4c8c27e7d0e8a114980a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.715915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed51309d98dfb7011e0d41dbcc4027d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-126.ec2.internal\" (UID: \"2ed51309d98dfb7011e0d41dbcc4027d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.715951 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed51309d98dfb7011e0d41dbcc4027d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-126.ec2.internal\" (UID: \"2ed51309d98dfb7011e0d41dbcc4027d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.715982 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7143e0b2c8c4c8c27e7d0e8a114980a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal\" (UID: \"b7143e0b2c8c4c8c27e7d0e8a114980a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.716002 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7143e0b2c8c4c8c27e7d0e8a114980a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal\" (UID: \"b7143e0b2c8c4c8c27e7d0e8a114980a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.747247 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.849427 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.864699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:23.905075 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:23.873969 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" Jul 16 00:44:24.084605 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:23.950273 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.084605 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.036440 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:24.084605 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:24.050834 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.128768 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.128908 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.128944 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:24.151602 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.216895 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 00:39:23 +0000 UTC" deadline="2028-02-21 21:42:02.095738418 +0000 UTC" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.216923 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14060h57m37.878819455s" Jul 16 00:44:24.257030 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:24.252437 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.402401 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:24.352624 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.526113 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:24.453649 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.554254 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:24.554226 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-126.ec2.internal\" not found" Jul 16 00:44:24.575931 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:24.575900 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed51309d98dfb7011e0d41dbcc4027d.slice/crio-3b2c6ba871255d9fc7fb5c77ab84daaca8a40e9e1e4daad3d80647f25bcb0afc WatchSource:0}: Error finding container 3b2c6ba871255d9fc7fb5c77ab84daaca8a40e9e1e4daad3d80647f25bcb0afc: Status 404 returned error can't find the container with id 3b2c6ba871255d9fc7fb5c77ab84daaca8a40e9e1e4daad3d80647f25bcb0afc Jul 16 00:44:24.587596 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.587575 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:44:24.591964 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.591939 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:24.604015 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:24.603991 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7143e0b2c8c4c8c27e7d0e8a114980a.slice/crio-be73f15f30af90a2716ed32af8fcb8dc360289eca9e4a489d9faaba5915828b7 WatchSource:0}: Error finding container be73f15f30af90a2716ed32af8fcb8dc360289eca9e4a489d9faaba5915828b7: Status 404 returned error can't find the container with id be73f15f30af90a2716ed32af8fcb8dc360289eca9e4a489d9faaba5915828b7 Jul 16 00:44:24.610463 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.610446 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" Jul 16 00:44:24.621105 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.621088 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:44:24.622243 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.622227 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" Jul 16 00:44:24.633222 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.633199 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:44:24.779842 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:24.779777 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:25.097367 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.097288 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:25.171995 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.171967 2573 apiserver.go:52] "Watching apiserver" Jul 16 00:44:25.178555 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.178497 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 00:44:25.179112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.179079 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hfb45","openshift-ovn-kubernetes/ovnkube-node-gflb8","kube-system/global-pull-secret-syncer-hwc2x","kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal","openshift-dns/node-resolver-48qqz","openshift-image-registry/node-ca-x5x6g","openshift-multus/multus-additional-cni-plugins-6s5sn","openshift-multus/network-metrics-daemon-bwp6p","openshift-network-diagnostics/network-check-target-xwkcb","openshift-network-operator/iptables-alerter-cqdzz","kube-system/konnectivity-agent-k27h7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm","openshift-cluster-node-tuning-operator/tuned-9k4lz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal"] Jul 16 00:44:25.181731 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.181708 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.184765 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.184030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.184765 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.184399 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.184765 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.184676 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 00:44:25.184765 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.184687 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fflk2\"" Jul 16 00:44:25.185030 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.184821 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.189628 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.189154 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 00:44:25.191096 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.189749 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 00:44:25.191096 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.189830 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.191096 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.189921 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:25.191351 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.191333 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r7tzh\"" Jul 16 00:44:25.195417 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.195397 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.197858 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.197839 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.198604 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.198581 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 00:44:25.198832 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.198815 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g4st4\"" Jul 16 00:44:25.198991 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.198967 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.199109 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.198981 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 00:44:25.199195 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.199175 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 00:44:25.199856 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.199838 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.202131 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.202113 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 00:44:25.202224 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.202145 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-st5bn\"" Jul 16 00:44:25.203260 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.202557 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.205043 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.204500 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.205043 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.204840 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tmqnz\"" Jul 16 00:44:25.205043 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.204846 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.205043 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.204984 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 00:44:25.205297 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.205097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:25.205297 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.205158 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:25.207490 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.207469 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.210000 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.209980 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nb6dc\"" Jul 16 00:44:25.210573 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.210554 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.210767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.210749 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.210880 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.210866 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.211674 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.211656 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 00:44:25.213038 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.213019 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.214499 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.213884 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 00:44:25.214499 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.214150 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.214499 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.214408 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.214897 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.215088 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.215249 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.215424 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4gvm2\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.215891 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.216120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.216154 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.216501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.216347 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nbsvb\"" Jul 16 00:44:25.217937 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.217916 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.218051 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.217994 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:25.218504 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.218485 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 00:44:25.218738 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.218677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 00:44:25.218941 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.218923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-277b4\"" Jul 16 00:44:25.219185 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.219166 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 00:44:25.222106 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.222086 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:44:25.223578 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-kubelet\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.223679 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-k8s-cni-cncf-io\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.223679 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-kubernetes\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.223679 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-var-lib-kubelet\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-cni-bin\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-socket-dir-parent\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/742556e8-796b-4231-bc39-e317f5289781-ovn-node-metrics-cert\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-iptables-alerter-script\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-os-release\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-netns\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.223847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysctl-d\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-sys\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-tuned\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-hosts-file\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223962 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-multus-certs\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.223998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-modprobe-d\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-etc-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224049 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-tmp-dir\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-env-overrides\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-cnibin\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbw96\" (UniqueName: \"kubernetes.io/projected/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-kube-api-access-qbw96\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-lib-modules\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224202 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-host\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-log-socket\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-cnibin\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysconfig\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-kubelet\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-cni-netd\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224355 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-ovnkube-config\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59cd7898-1ce5-476a-a6be-92f9f8c832b5-cni-binary-copy\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-cni-bin\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-ovn\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-node-log\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-run-ovn-kubernetes\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-ovnkube-script-lib\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-host-slash\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-run-netns\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-systemd\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.224928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-var-lib-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84jdm\" (UniqueName: \"kubernetes.io/projected/742556e8-796b-4231-bc39-e317f5289781-kube-api-access-84jdm\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxdk\" (UniqueName: \"kubernetes.io/projected/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-kube-api-access-tvxdk\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224700 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-cni-binary-copy\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-serviceca\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-systemd-units\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lckd9\" (UniqueName: \"kubernetes.io/projected/c7a433a3-b668-4fed-803f-eb31d9d4e767-kube-api-access-lckd9\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224781 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmrw\" (UniqueName: \"kubernetes.io/projected/1f1c9d22-7170-432e-923c-0c54de461627-kube-api-access-jlmrw\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224840 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-cni-multus\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-conf-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-daemon-config\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-etc-kubernetes\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-system-cni-dir\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l24rb\" (UniqueName: \"kubernetes.io/projected/5e846c4f-f1b5-4fee-9994-d288ced6eeca-kube-api-access-l24rb\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.225789 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-slash\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.224991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c-agent-certs\") pod \"konnectivity-agent-k27h7\" (UID: \"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c\") " pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-os-release\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysctl-conf\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-run\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c-konnectivity-ca\") pod \"konnectivity-agent-k27h7\" (UID: \"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c\") " pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225068 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-host\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntlp\" (UniqueName: \"kubernetes.io/projected/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-kube-api-access-kntlp\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-system-cni-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225202 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-hostroot\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-cni-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gk96\" (UniqueName: \"kubernetes.io/projected/59cd7898-1ce5-476a-a6be-92f9f8c832b5-kube-api-access-6gk96\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-systemd\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.226583 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.225308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e846c4f-f1b5-4fee-9994-d288ced6eeca-tmp\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.254872 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.254481 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-74wj4" Jul 16 00:44:25.263499 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.263117 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-74wj4" Jul 16 00:44:25.312254 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.312230 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 00:44:25.325999 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.325972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-hosts-file\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.326112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326010 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-multus-certs\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.326112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-modprobe-d\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-etc-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-tmp-dir\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-registration-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326137 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-multus-certs\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-env-overrides\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326164 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-etc-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-cnibin\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbw96\" (UniqueName: \"kubernetes.io/projected/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-kube-api-access-qbw96\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-lib-modules\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-host\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326309 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-modprobe-d\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326234 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-hosts-file\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326368 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-log-socket\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326448 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-lib-modules\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326488 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-host\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326496 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-tmp-dir\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-log-socket\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-cnibin\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysconfig\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-sys-fs\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26cc39bb-eb04-4021-b504-4615d81e37db-dbus\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326692 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-cnibin\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-kubelet\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326740 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-kubelet\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-cni-netd\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326751 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysconfig\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326777 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-cni-netd\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-ovnkube-config\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326809 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-cnibin\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.326957 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326815 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-env-overrides\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59cd7898-1ce5-476a-a6be-92f9f8c832b5-cni-binary-copy\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-cni-bin\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-device-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326948 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-cni-bin\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-ovn\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.326993 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-node-log\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-run-ovn-kubernetes\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-ovnkube-script-lib\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327061 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-node-log\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327022 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-ovn\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-host-slash\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327114 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-run-ovn-kubernetes\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327131 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-host-slash\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-run-netns\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.327889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327183 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-systemd\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-var-lib-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84jdm\" (UniqueName: \"kubernetes.io/projected/742556e8-796b-4231-bc39-e317f5289781-kube-api-access-84jdm\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327253 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-run-netns\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327252 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-ovnkube-config\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxdk\" (UniqueName: \"kubernetes.io/projected/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-kube-api-access-tvxdk\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327297 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-run-systemd\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327297 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-cni-binary-copy\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-serviceca\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-systemd-units\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lckd9\" (UniqueName: \"kubernetes.io/projected/c7a433a3-b668-4fed-803f-eb31d9d4e767-kube-api-access-lckd9\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmrw\" (UniqueName: \"kubernetes.io/projected/1f1c9d22-7170-432e-923c-0c54de461627-kube-api-access-jlmrw\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327487 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59cd7898-1ce5-476a-a6be-92f9f8c832b5-cni-binary-copy\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327504 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-cni-multus\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-conf-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.328768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-daemon-config\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-etc-kubernetes\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327652 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/742556e8-796b-4231-bc39-e317f5289781-ovnkube-script-lib\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-system-cni-dir\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l24rb\" (UniqueName: \"kubernetes.io/projected/5e846c4f-f1b5-4fee-9994-d288ced6eeca-kube-api-access-l24rb\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-slash\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c-agent-certs\") pod \"konnectivity-agent-k27h7\" (UID: \"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c\") " pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-os-release\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysctl-conf\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-run\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327877 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-systemd-units\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-socket-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327937 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-conf-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c-konnectivity-ca\") pod \"konnectivity-agent-k27h7\" (UID: \"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c\") " pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328004 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.329688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-host\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328055 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntlp\" (UniqueName: \"kubernetes.io/projected/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-kube-api-access-kntlp\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-system-cni-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-hostroot\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26cc39bb-eb04-4021-b504-4615d81e37db-kubelet-config\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328197 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-serviceca\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-cni-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gk96\" (UniqueName: \"kubernetes.io/projected/59cd7898-1ce5-476a-a6be-92f9f8c832b5-kube-api-access-6gk96\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328276 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-systemd\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328302 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e846c4f-f1b5-4fee-9994-d288ced6eeca-tmp\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-etc-selinux\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-kubelet\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328400 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-cni-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-k8s-cni-cncf-io\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328433 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-daemon-config\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327316 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-var-lib-openvswitch\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.330612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-kubernetes\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328457 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-host\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328493 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328554 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-etc-kubernetes\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328553 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-system-cni-dir\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328600 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-system-cni-dir\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-var-lib-kubelet\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.327549 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-cni-multus\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328721 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-systemd\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328726 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-run\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-cni-bin\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328763 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-hostroot\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-socket-dir-parent\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328802 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysctl-conf\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328815 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328836 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.328882 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328895 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-var-lib-kubelet\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.331507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328932 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-slash\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.328959 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:25.82893825 +0000 UTC m=+3.020383797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328969 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-k8s-cni-cncf-io\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.328982 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c-konnectivity-ca\") pod \"konnectivity-agent-k27h7\" (UID: \"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c\") " pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329013 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-multus-socket-dir-parent\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329019 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f1c9d22-7170-432e-923c-0c54de461627-os-release\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/742556e8-796b-4231-bc39-e317f5289781-ovn-node-metrics-cert\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329058 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-var-lib-kubelet\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329069 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-kubernetes\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329109 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-iptables-alerter-script\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-os-release\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-netns\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329209 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-host-run-netns\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329214 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-cni-bin\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysctl-d\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329257 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f1c9d22-7170-432e-923c-0c54de461627-cni-binary-copy\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329274 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59cd7898-1ce5-476a-a6be-92f9f8c832b5-os-release\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.332396 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-sys\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329400 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-sysctl-d\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329450 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/742556e8-796b-4231-bc39-e317f5289781-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-tuned\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329512 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e846c4f-f1b5-4fee-9994-d288ced6eeca-sys\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hmg7\" (UniqueName: \"kubernetes.io/projected/5568d05e-a892-44ed-98b2-0aea875f6041-kube-api-access-4hmg7\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.333361 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.329727 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-iptables-alerter-script\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.334609 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.334237 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e846c4f-f1b5-4fee-9994-d288ced6eeca-tmp\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.334717 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.334662 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:25.334717 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.334686 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:25.334827 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.334734 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:25.334827 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.334798 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:25.834779661 +0000 UTC m=+3.026225198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:25.337376 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.337316 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/742556e8-796b-4231-bc39-e317f5289781-ovn-node-metrics-cert\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.338175 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.337901 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e846c4f-f1b5-4fee-9994-d288ced6eeca-etc-tuned\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.338175 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.338134 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c-agent-certs\") pod \"konnectivity-agent-k27h7\" (UID: \"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c\") " pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.342698 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.342431 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntlp\" (UniqueName: \"kubernetes.io/projected/3bf34870-9894-4bbe-97cb-aa1d0f1b056f-kube-api-access-kntlp\") pod \"node-resolver-48qqz\" (UID: \"3bf34870-9894-4bbe-97cb-aa1d0f1b056f\") " pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.346819 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.346774 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmrw\" (UniqueName: \"kubernetes.io/projected/1f1c9d22-7170-432e-923c-0c54de461627-kube-api-access-jlmrw\") pod \"multus-additional-cni-plugins-6s5sn\" (UID: \"1f1c9d22-7170-432e-923c-0c54de461627\") " pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.347522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.347438 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxdk\" (UniqueName: \"kubernetes.io/projected/5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b-kube-api-access-tvxdk\") pod \"iptables-alerter-cqdzz\" (UID: \"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b\") " pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.347522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.347499 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gk96\" (UniqueName: \"kubernetes.io/projected/59cd7898-1ce5-476a-a6be-92f9f8c832b5-kube-api-access-6gk96\") pod \"multus-hfb45\" (UID: \"59cd7898-1ce5-476a-a6be-92f9f8c832b5\") " pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.347666 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.347531 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84jdm\" (UniqueName: \"kubernetes.io/projected/742556e8-796b-4231-bc39-e317f5289781-kube-api-access-84jdm\") pod \"ovnkube-node-gflb8\" (UID: \"742556e8-796b-4231-bc39-e317f5289781\") " pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.348245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.348202 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lckd9\" (UniqueName: \"kubernetes.io/projected/c7a433a3-b668-4fed-803f-eb31d9d4e767-kube-api-access-lckd9\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.348851 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.348825 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbw96\" (UniqueName: \"kubernetes.io/projected/079acca2-8fc9-4a09-8fbd-2e3b16d32b85-kube-api-access-qbw96\") pod \"node-ca-x5x6g\" (UID: \"079acca2-8fc9-4a09-8fbd-2e3b16d32b85\") " pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.351101 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.351058 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l24rb\" (UniqueName: \"kubernetes.io/projected/5e846c4f-f1b5-4fee-9994-d288ced6eeca-kube-api-access-l24rb\") pod \"tuned-9k4lz\" (UID: \"5e846c4f-f1b5-4fee-9994-d288ced6eeca\") " pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.430207 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430178 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430359 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-socket-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430359 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26cc39bb-eb04-4021-b504-4615d81e37db-kubelet-config\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.430359 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-etc-selinux\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430359 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.430619 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hmg7\" (UniqueName: \"kubernetes.io/projected/5568d05e-a892-44ed-98b2-0aea875f6041-kube-api-access-4hmg7\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430619 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-registration-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430619 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430479 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-sys-fs\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430619 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430504 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26cc39bb-eb04-4021-b504-4615d81e37db-dbus\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.430619 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-device-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430878 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430634 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-device-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430878 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430696 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430878 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430817 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-socket-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.430878 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430867 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26cc39bb-eb04-4021-b504-4615d81e37db-kubelet-config\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.431078 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.430965 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-etc-selinux\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.431078 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.431056 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:25.431189 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.431107 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:44:25.931088179 +0000 UTC m=+3.122533700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:25.431525 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.431502 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-registration-dir\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.431623 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.431568 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5568d05e-a892-44ed-98b2-0aea875f6041-sys-fs\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.431680 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.431629 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26cc39bb-eb04-4021-b504-4615d81e37db-dbus\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.441617 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.441384 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hmg7\" (UniqueName: \"kubernetes.io/projected/5568d05e-a892-44ed-98b2-0aea875f6041-kube-api-access-4hmg7\") pod \"aws-ebs-csi-driver-node-6tzwm\" (UID: \"5568d05e-a892-44ed-98b2-0aea875f6041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.441721 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.441643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" event={"ID":"b7143e0b2c8c4c8c27e7d0e8a114980a","Type":"ContainerStarted","Data":"be73f15f30af90a2716ed32af8fcb8dc360289eca9e4a489d9faaba5915828b7"} Jul 16 00:44:25.443706 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.443645 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" event={"ID":"2ed51309d98dfb7011e0d41dbcc4027d","Type":"ContainerStarted","Data":"3b2c6ba871255d9fc7fb5c77ab84daaca8a40e9e1e4daad3d80647f25bcb0afc"} Jul 16 00:44:25.502453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.502415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cqdzz" Jul 16 00:44:25.512521 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.512498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:25.513659 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:25.513630 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5c97c3_b4d6_4590_9ecc_cde2ad2ed15b.slice/crio-8d98c5a072159cc29a966fdac8e2bb2758220c8930e4083afe63d797c1b09c6b WatchSource:0}: Error finding container 8d98c5a072159cc29a966fdac8e2bb2758220c8930e4083afe63d797c1b09c6b: Status 404 returned error can't find the container with id 8d98c5a072159cc29a966fdac8e2bb2758220c8930e4083afe63d797c1b09c6b Jul 16 00:44:25.525194 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:25.525170 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3c522d_bfc4_4ba7_a7eb_020ca08ada8c.slice/crio-458753bd4187676a50c54004448626142e9158f8acd2adf84c04b8263d45d959 WatchSource:0}: Error finding container 458753bd4187676a50c54004448626142e9158f8acd2adf84c04b8263d45d959: Status 404 returned error can't find the container with id 458753bd4187676a50c54004448626142e9158f8acd2adf84c04b8263d45d959 Jul 16 00:44:25.527069 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.527049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" Jul 16 00:44:25.533723 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.533700 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hfb45" Jul 16 00:44:25.537477 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:25.537450 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1c9d22_7170_432e_923c_0c54de461627.slice/crio-b681eda7c8b455905610da254d850f540c3dfe00ec2d246ba788a3be851774a9 WatchSource:0}: Error finding container b681eda7c8b455905610da254d850f540c3dfe00ec2d246ba788a3be851774a9: Status 404 returned error can't find the container with id b681eda7c8b455905610da254d850f540c3dfe00ec2d246ba788a3be851774a9 Jul 16 00:44:25.543146 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.543066 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x5x6g" Jul 16 00:44:25.544628 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:25.543787 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cd7898_1ce5_476a_a6be_92f9f8c832b5.slice/crio-926ebb94fa3b863914e191f318ad2e16b797e907f545f8208c998b36966f2567 WatchSource:0}: Error finding container 926ebb94fa3b863914e191f318ad2e16b797e907f545f8208c998b36966f2567: Status 404 returned error can't find the container with id 926ebb94fa3b863914e191f318ad2e16b797e907f545f8208c998b36966f2567 Jul 16 00:44:25.551433 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.551238 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" Jul 16 00:44:25.559019 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:25.558911 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079acca2_8fc9_4a09_8fbd_2e3b16d32b85.slice/crio-f8280fee58229eb37ed000a2290b69b4a054055abf88ea37e7f06ae935fc8b33 WatchSource:0}: Error finding container f8280fee58229eb37ed000a2290b69b4a054055abf88ea37e7f06ae935fc8b33: Status 404 returned error can't find the container with id f8280fee58229eb37ed000a2290b69b4a054055abf88ea37e7f06ae935fc8b33 Jul 16 00:44:25.560581 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.560559 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:25.561639 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:25.561614 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e846c4f_f1b5_4fee_9994_d288ced6eeca.slice/crio-f0bf5d14f5d420ddbae511e51d2d129c4747fe76a43b2b73764ba6bcc559098a WatchSource:0}: Error finding container f0bf5d14f5d420ddbae511e51d2d129c4747fe76a43b2b73764ba6bcc559098a: Status 404 returned error can't find the container with id f0bf5d14f5d420ddbae511e51d2d129c4747fe76a43b2b73764ba6bcc559098a Jul 16 00:44:25.569703 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.569680 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-48qqz" Jul 16 00:44:25.578784 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.578758 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" Jul 16 00:44:25.834725 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.834635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:25.834902 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.834800 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:25.834902 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.834873 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:26.834850894 +0000 UTC m=+4.026296413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:25.935331 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.935298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:25.935331 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:25.935338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:25.935599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.935465 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:25.935599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.935507 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:25.935599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.935528 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:25.935599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.935539 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:25.935599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.935550 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:44:26.935524699 +0000 UTC m=+4.126970218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:25.935599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:25.935583 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:26.935568452 +0000 UTC m=+4.127013971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:26.266807 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.266652 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:39:25 +0000 UTC" deadline="2028-03-07 04:27:49.899539588 +0000 UTC" Jul 16 00:44:26.266807 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.266710 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14403h43m23.632833318s" Jul 16 00:44:26.430720 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.430688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:26.430888 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.430824 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:26.448543 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.448508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hfb45" event={"ID":"59cd7898-1ce5-476a-a6be-92f9f8c832b5","Type":"ContainerStarted","Data":"926ebb94fa3b863914e191f318ad2e16b797e907f545f8208c998b36966f2567"} Jul 16 00:44:26.450700 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.450669 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerStarted","Data":"b681eda7c8b455905610da254d850f540c3dfe00ec2d246ba788a3be851774a9"} Jul 16 00:44:26.453032 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.453004 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k27h7" event={"ID":"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c","Type":"ContainerStarted","Data":"458753bd4187676a50c54004448626142e9158f8acd2adf84c04b8263d45d959"} Jul 16 00:44:26.455540 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.455516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqdzz" event={"ID":"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b","Type":"ContainerStarted","Data":"8d98c5a072159cc29a966fdac8e2bb2758220c8930e4083afe63d797c1b09c6b"} Jul 16 00:44:26.457295 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.457270 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" event={"ID":"5e846c4f-f1b5-4fee-9994-d288ced6eeca","Type":"ContainerStarted","Data":"f0bf5d14f5d420ddbae511e51d2d129c4747fe76a43b2b73764ba6bcc559098a"} Jul 16 00:44:26.459429 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.459394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x5x6g" event={"ID":"079acca2-8fc9-4a09-8fbd-2e3b16d32b85","Type":"ContainerStarted","Data":"f8280fee58229eb37ed000a2290b69b4a054055abf88ea37e7f06ae935fc8b33"} Jul 16 00:44:26.842572 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.842532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:26.842825 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.842676 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:26.842825 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.842744 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.842722653 +0000 UTC m=+6.034168175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:26.943871 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.943835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:26.944054 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:26.943903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:26.944117 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.944102 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:26.944187 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.944124 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:26.944187 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.944139 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:26.944290 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.944196 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.944177043 +0000 UTC m=+6.135622565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:26.944667 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.944636 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:26.944769 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:26.944694 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:44:28.944678007 +0000 UTC m=+6.136123529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:27.108878 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:27.108848 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf34870_9894_4bbe_97cb_aa1d0f1b056f.slice/crio-07e01f815f9d5225dabe4465608d416a201c76925946303257425def8e6bc725 WatchSource:0}: Error finding container 07e01f815f9d5225dabe4465608d416a201c76925946303257425def8e6bc725: Status 404 returned error can't find the container with id 07e01f815f9d5225dabe4465608d416a201c76925946303257425def8e6bc725 Jul 16 00:44:27.110648 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:27.110621 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5568d05e_a892_44ed_98b2_0aea875f6041.slice/crio-ea4a6b5470195d4928f07762a74fe8f3a6d14c90dbf950363094a2d02a309853 WatchSource:0}: Error finding container ea4a6b5470195d4928f07762a74fe8f3a6d14c90dbf950363094a2d02a309853: Status 404 returned error can't find the container with id ea4a6b5470195d4928f07762a74fe8f3a6d14c90dbf950363094a2d02a309853 Jul 16 00:44:27.268058 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.267853 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:39:25 +0000 UTC" deadline="2028-04-15 04:10:24.933870052 +0000 UTC" Jul 16 00:44:27.268058 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.267891 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15339h25m57.665984085s" Jul 16 00:44:27.302741 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.302712 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:44:27.430803 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.430704 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:27.430984 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:27.430865 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:27.430984 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.430912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:27.431109 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:27.431030 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:27.464229 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.464195 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" event={"ID":"5568d05e-a892-44ed-98b2-0aea875f6041","Type":"ContainerStarted","Data":"ea4a6b5470195d4928f07762a74fe8f3a6d14c90dbf950363094a2d02a309853"} Jul 16 00:44:27.466601 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.466509 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-48qqz" event={"ID":"3bf34870-9894-4bbe-97cb-aa1d0f1b056f","Type":"ContainerStarted","Data":"07e01f815f9d5225dabe4465608d416a201c76925946303257425def8e6bc725"} Jul 16 00:44:27.468591 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.468496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"4c859be70b7eed0286cf903175334182142a5e7002b4bb7c2122134044f5ccd8"} Jul 16 00:44:27.476073 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:27.475319 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" event={"ID":"2ed51309d98dfb7011e0d41dbcc4027d","Type":"ContainerStarted","Data":"d6e3d0080a50e036424b7b9aaaaf47cc051dfec1194e0400b825c0581c7c3ee2"} Jul 16 00:44:28.430574 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.430152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:28.430574 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.430278 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:28.478823 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.478784 2573 generic.go:356] "Generic (PLEG): container finished" podID="b7143e0b2c8c4c8c27e7d0e8a114980a" containerID="420e3583c651ff1e3ddff8f2a700505518f6fee29c91e4ab6f8780749239ced1" exitCode=0 Jul 16 00:44:28.479336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.479307 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" event={"ID":"b7143e0b2c8c4c8c27e7d0e8a114980a","Type":"ContainerDied","Data":"420e3583c651ff1e3ddff8f2a700505518f6fee29c91e4ab6f8780749239ced1"} Jul 16 00:44:28.500186 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.500091 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-126.ec2.internal" podStartSLOduration=4.500073124 podStartE2EDuration="4.500073124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:27.493433711 +0000 UTC m=+4.684879256" watchObservedRunningTime="2026-07-16 00:44:28.500073124 +0000 UTC m=+5.691518667" Jul 16 00:44:28.860355 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.859737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:28.860355 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.859888 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:28.860355 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.859946 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:32.859925205 +0000 UTC m=+10.051370722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:28.961599 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.960920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:28.961599 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:28.960979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:28.961599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.961220 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:28.961599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.961279 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:44:32.961262016 +0000 UTC m=+10.152707533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:28.961599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.961575 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:28.961599 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.961602 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:28.962022 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.961616 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:28.962022 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:28.961681 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:32.961662336 +0000 UTC m=+10.153107875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:29.432038 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:29.431507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:29.432038 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:29.431655 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:29.432884 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:29.432672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:29.432884 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:29.432798 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:30.430273 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:30.430241 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:30.430480 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:30.430379 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:31.430923 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:31.430842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:31.431355 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:31.430953 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:31.431355 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:31.430842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:31.431355 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:31.431249 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:32.430542 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:32.430497 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:32.430694 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.430632 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:32.893793 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:32.893592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:32.893793 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.893786 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:32.894270 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.893852 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:40.893831835 +0000 UTC m=+18.085277354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:32.994862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:32.994917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.995065 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.995081 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.995094 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.995147 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:40.995129466 +0000 UTC m=+18.186574985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.995569 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:32.995645 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:32.995624 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:44:40.99560742 +0000 UTC m=+18.187052939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:33.434422 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:33.434153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:33.434422 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:33.434314 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:33.434422 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:33.434363 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:33.435110 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:33.435068 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:34.430606 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:34.430561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:34.431069 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:34.430693 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:35.433680 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:35.433607 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:35.434142 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:35.433740 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:35.434142 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:35.433824 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:35.434142 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:35.433963 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:36.430619 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:36.430586 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:36.430779 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:36.430711 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:37.430211 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:37.430175 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:37.430666 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:37.430308 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:37.430666 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:37.430375 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:37.430666 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:37.430533 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:38.429980 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:38.429943 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:38.430140 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:38.430055 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:39.430659 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:39.430630 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:39.430991 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:39.430637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:39.430991 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:39.430749 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:39.430991 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:39.430827 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:40.430484 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:40.430452 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:40.430699 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:40.430553 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:40.953126 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:40.953086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:40.953316 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:40.953209 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:40.953316 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:40.953281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:56.953260629 +0000 UTC m=+34.144706167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:41.054418 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:41.054370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:41.054589 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:41.054481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:41.054589 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.054579 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:41.054693 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.054649 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:44:57.054628281 +0000 UTC m=+34.246073815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:41.054693 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.054578 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:41.054858 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.054709 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:41.054858 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.054728 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:41.054858 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.054789 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:57.05477148 +0000 UTC m=+34.246217027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:41.430861 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:41.430827 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:41.430861 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:41.430846 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:41.431344 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.430963 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:41.431344 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:41.431085 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:42.430616 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:42.430583 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:42.430788 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:42.430683 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:43.430813 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:43.430780 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:43.431315 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:43.430858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:43.431315 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:43.430887 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:43.431315 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:43.430947 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:44.430383 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.430235 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:44.430587 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:44.430510 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:44.509993 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.509958 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f1c9d22-7170-432e-923c-0c54de461627" containerID="35781a8cc8d9faa43ce90c857078105ce1391ef8a46e3c3e5cc1fc7decb3cb26" exitCode=0 Jul 16 00:44:44.510641 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.510036 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerDied","Data":"35781a8cc8d9faa43ce90c857078105ce1391ef8a46e3c3e5cc1fc7decb3cb26"} Jul 16 00:44:44.511591 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.511502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k27h7" event={"ID":"ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c","Type":"ContainerStarted","Data":"3143de359e498a7cf9dbf0aecc41d26aa713102b145f4923605ef6c137f5f544"} Jul 16 00:44:44.513059 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.513026 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" event={"ID":"5e846c4f-f1b5-4fee-9994-d288ced6eeca","Type":"ContainerStarted","Data":"cfa7b095cb6b581b111197a21b1a717e3034678595cbae79550e53a0b3a8c61d"} Jul 16 00:44:44.514841 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.514805 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" event={"ID":"5568d05e-a892-44ed-98b2-0aea875f6041","Type":"ContainerStarted","Data":"57f5cb0436c785fafe5c608fed3eaf93abb539e9be1a5a6cdb3865717e675ed4"} Jul 16 00:44:44.516285 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.516264 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-48qqz" event={"ID":"3bf34870-9894-4bbe-97cb-aa1d0f1b056f","Type":"ContainerStarted","Data":"c0a48004d5c6632c54dd6bd250c7c729b8f8d0fe9a834b9a63f595837d6e0364"} Jul 16 00:44:44.518643 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.518619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" event={"ID":"b7143e0b2c8c4c8c27e7d0e8a114980a","Type":"ContainerStarted","Data":"daaabfb5d4f2851700a112cd9ca4660b1200fcc7de64749b08ec3d23c1ff319e"} Jul 16 00:44:44.520114 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.520054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x5x6g" event={"ID":"079acca2-8fc9-4a09-8fbd-2e3b16d32b85","Type":"ContainerStarted","Data":"e1c13c127f52a93c97b105570f54a5fc33e8209961d529b7505add0cae2447d4"} Jul 16 00:44:44.521546 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.521525 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hfb45" event={"ID":"59cd7898-1ce5-476a-a6be-92f9f8c832b5","Type":"ContainerStarted","Data":"39bd2587021d5481750ac6027b36cce483b01414e751a2460fa35e5895c200ab"} Jul 16 00:44:44.548324 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.548269 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x5x6g" podStartSLOduration=3.153686065 podStartE2EDuration="21.548255543s" totalImagesPullingTime="18.394569478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.54808492 +0000 UTC m=+21.739530458" watchObservedRunningTime="2026-07-16 00:44:44.548255543 +0000 UTC m=+21.739701081" Jul 16 00:44:44.563269 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.563217 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-126.ec2.internal" podStartSLOduration=20.563204945 podStartE2EDuration="20.563204945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.563008399 +0000 UTC m=+21.754453952" watchObservedRunningTime="2026-07-16 00:44:44.563204945 +0000 UTC m=+21.754650484" Jul 16 00:44:44.578751 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.578549 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k27h7" podStartSLOduration=3.150593753 podStartE2EDuration="21.578537923s" totalImagesPullingTime="18.42794417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.578424228 +0000 UTC m=+21.769869769" watchObservedRunningTime="2026-07-16 00:44:44.578537923 +0000 UTC m=+21.769983463" Jul 16 00:44:44.596528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.596483 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hfb45" podStartSLOduration=2.846091897 podStartE2EDuration="21.596470309s" totalImagesPullingTime="18.750378412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.596107173 +0000 UTC m=+21.787552712" watchObservedRunningTime="2026-07-16 00:44:44.596470309 +0000 UTC m=+21.787915847" Jul 16 00:44:44.617205 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:44.617165 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9k4lz" podStartSLOduration=3.225542623 podStartE2EDuration="21.61715053s" totalImagesPullingTime="18.391607907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.616861944 +0000 UTC m=+21.808307495" watchObservedRunningTime="2026-07-16 00:44:44.61715053 +0000 UTC m=+21.808596083" Jul 16 00:44:45.430687 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.430661 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:45.430782 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:45.430766 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:45.430843 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.430823 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:45.430970 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:45.430947 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:45.464297 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.464275 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:45.465047 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.465026 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:45.483512 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.483465 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-48qqz" podStartSLOduration=4.668817218 podStartE2EDuration="21.483446732s" totalImagesPullingTime="16.814629514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:44.633533603 +0000 UTC m=+21.824979142" watchObservedRunningTime="2026-07-16 00:44:45.483446732 +0000 UTC m=+22.674892250" Jul 16 00:44:45.525727 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.525667 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cqdzz" event={"ID":"5a5c97c3-b4d6-4590-9ecc-cde2ad2ed15b","Type":"ContainerStarted","Data":"a91f3fd00c519a297f7ebf31e8d5f104ced6bf7e461805704aecfa1a17365a47"} Jul 16 00:44:45.527835 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.527810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"6f1ad7074b84981d9304fe3d550ddd3f117863e1811231e0f99b73c4e489da8e"} Jul 16 00:44:45.527943 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.527889 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"13d69c2faec3d453bff72129fa6cf7fe007672fec1cca878ffc8d0a7a106142f"} Jul 16 00:44:45.718507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:45.718312 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 00:44:46.310612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.310481 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T00:44:45.718504726Z","UUID":"819abd21-7dfb-40c3-9631-fdb90ead50fc","Handler":null,"Name":"","Endpoint":""} Jul 16 00:44:46.312198 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.312174 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 00:44:46.312305 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.312219 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 00:44:46.430922 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.430895 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:46.431100 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:46.431016 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:46.531981 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.531943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" event={"ID":"5568d05e-a892-44ed-98b2-0aea875f6041","Type":"ContainerStarted","Data":"91502d8bce4cc49484e165fb4bfbaffb77e1f746048dce8532754d1b7fe45cd2"} Jul 16 00:44:46.534818 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.534794 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:44:46.535209 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535187 2573 generic.go:356] "Generic (PLEG): container finished" podID="742556e8-796b-4231-bc39-e317f5289781" containerID="6f1ad7074b84981d9304fe3d550ddd3f117863e1811231e0f99b73c4e489da8e" exitCode=1 Jul 16 00:44:46.535297 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerDied","Data":"6f1ad7074b84981d9304fe3d550ddd3f117863e1811231e0f99b73c4e489da8e"} Jul 16 00:44:46.535297 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535293 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 00:44:46.535390 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535341 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"8ec2325c3d52e347d0fe12c252ed40f6b42c7a12bb60995015c7d0f3929be4e4"} Jul 16 00:44:46.535452 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"e6184577444fa30b909126adfbe30b2e9a827edae40bded3561b5ec729963f32"} Jul 16 00:44:46.535489 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"1ff45c3bbf1050da8ad10d563037b772e9bce04527c687cd1d83dbc656f09197"} Jul 16 00:44:46.535527 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:46.535501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"2cd46ab39c4e509e8c5ce965f8ccbebf13504f64d175f6bc8d497ab226ca2fda"} Jul 16 00:44:47.431014 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:47.430816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:47.431276 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:47.430865 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:47.431276 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:47.431131 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:47.431276 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:47.431196 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:47.540529 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:47.540496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" event={"ID":"5568d05e-a892-44ed-98b2-0aea875f6041","Type":"ContainerStarted","Data":"d7520f9d0ae47bc10e38b064093dcbffc53b2693bfe7416e3f9e36bbcbc24785"} Jul 16 00:44:47.560027 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:47.559981 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cqdzz" podStartSLOduration=11.388331248 podStartE2EDuration="24.559963998s" totalImagesPullingTime="13.17163275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:45.543771479 +0000 UTC m=+22.735217019" watchObservedRunningTime="2026-07-16 00:44:47.559963998 +0000 UTC m=+24.751409537" Jul 16 00:44:48.429912 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:48.429883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:48.430093 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:48.430005 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:49.430483 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.430454 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:49.431070 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:49.430552 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:49.431070 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.430626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:49.431070 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:49.430713 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:49.549151 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.549121 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f1c9d22-7170-432e-923c-0c54de461627" containerID="b33262e6bfb3426dc31d55261252f28030a2ba57e3adbf74d8c8e28c6903ca8e" exitCode=0 Jul 16 00:44:49.549297 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.549212 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerDied","Data":"b33262e6bfb3426dc31d55261252f28030a2ba57e3adbf74d8c8e28c6903ca8e"} Jul 16 00:44:49.554334 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.554318 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:44:49.554670 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.554653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"5346cccce7269c49d991d69c79062cb87e8971d7ec44f1a0aa494efc904334a9"} Jul 16 00:44:49.572647 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:49.572606 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6tzwm" podStartSLOduration=6.5425711 podStartE2EDuration="25.57259408s" totalImagesPullingTime="19.03002298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:47.559455908 +0000 UTC m=+24.750901450" watchObservedRunningTime="2026-07-16 00:44:49.57259408 +0000 UTC m=+26.764039663" Jul 16 00:44:50.430508 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:50.430489 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:50.431006 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:50.430579 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:50.558648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:50.558619 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f1c9d22-7170-432e-923c-0c54de461627" containerID="5786a239ef5d2a34509b262a129f3525db847c7fb9a9c0d935b1cf55952849e4" exitCode=0 Jul 16 00:44:50.558794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:50.558675 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerDied","Data":"5786a239ef5d2a34509b262a129f3525db847c7fb9a9c0d935b1cf55952849e4"} Jul 16 00:44:51.357697 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.357453 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:51.357822 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.357744 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 00:44:51.358040 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.358021 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k27h7" Jul 16 00:44:51.429995 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.429969 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:51.430088 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.430012 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:51.430154 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:51.430111 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:51.430229 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:51.430206 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:51.439534 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.439514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:51.532282 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.532236 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:51.567093 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.567074 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:44:51.567438 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.567414 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"78b1024528ac3fb31bed8f2d13242abc6501e01fc98776be9745571406b35ae6"} Jul 16 00:44:51.567662 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.567646 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:51.567746 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.567719 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:51.567828 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.567806 2573 scope.go:117] "RemoveContainer" containerID="6f1ad7074b84981d9304fe3d550ddd3f117863e1811231e0f99b73c4e489da8e" Jul 16 00:44:51.570103 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.570081 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f1c9d22-7170-432e-923c-0c54de461627" containerID="dcf6b80615ebce62b6deb7974245a158c9be149f689d16eede5e0621e8e3fc96" exitCode=0 Jul 16 00:44:51.570203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.570177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerDied","Data":"dcf6b80615ebce62b6deb7974245a158c9be149f689d16eede5e0621e8e3fc96"} Jul 16 00:44:51.582745 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:51.582728 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:52.430457 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.430426 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:52.430629 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:52.430561 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:52.577222 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.577196 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:44:52.577659 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.577633 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" event={"ID":"742556e8-796b-4231-bc39-e317f5289781","Type":"ContainerStarted","Data":"ecd42dd8c2f04220e84acab69dc063f1d1de0addb1e1d002e203de0781993190"} Jul 16 00:44:52.577979 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.577904 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:52.595237 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.595214 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:44:52.609949 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.609436 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" podStartSLOduration=11.447556946 podStartE2EDuration="29.609418048s" totalImagesPullingTime="18.161861102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:52.608272691 +0000 UTC m=+29.799718231" watchObservedRunningTime="2026-07-16 00:44:52.609418048 +0000 UTC m=+29.800863585" Jul 16 00:44:52.626908 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.626728 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:52.689319 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.689176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:52.764797 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.764730 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xwkcb"] Jul 16 00:44:52.764962 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.764897 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:52.765051 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:52.765026 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:52.765662 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.765624 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwc2x"] Jul 16 00:44:52.765826 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.765716 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:52.765826 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:52.765799 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:52.766387 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.766360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bwp6p"] Jul 16 00:44:52.766509 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:52.766496 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:52.766639 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:52.766611 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:54.430568 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:54.430537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:54.430568 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:54.430560 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:54.431105 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:54.430679 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:54.431105 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:54.430713 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:54.431105 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:54.430778 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:54.431105 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:54.430835 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:56.430704 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:56.430674 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:56.431283 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:56.430678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:56.431283 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:56.430763 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:56.431283 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:56.430793 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:56.431283 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:56.430884 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:56.431283 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:56.430953 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:56.588544 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:56.588512 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f1c9d22-7170-432e-923c-0c54de461627" containerID="86a83943f38e2ed21b1c8de3d48f88927c4d0113fc2f5e7c06cbca2c18f18e2d" exitCode=0 Jul 16 00:44:56.588682 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:56.588571 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerDied","Data":"86a83943f38e2ed21b1c8de3d48f88927c4d0113fc2f5e7c06cbca2c18f18e2d"} Jul 16 00:44:56.973760 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:56.973676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:56.973903 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:56.973822 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:56.973903 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:56.973880 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:28.973865678 +0000 UTC m=+66.165311198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:44:57.074014 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:57.073985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:57.074152 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:57.074027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:57.074152 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:57.074140 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:57.074247 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:57.074156 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:44:57.074247 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:57.074172 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:44:57.074247 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:57.074185 2573 projected.go:196] Error preparing data for projected volume kube-api-access-kbdz7 for pod openshift-network-diagnostics/network-check-target-xwkcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:57.074247 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:57.074201 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret podName:26cc39bb-eb04-4021-b504-4615d81e37db nodeName:}" failed. No retries permitted until 2026-07-16 00:45:29.074184063 +0000 UTC m=+66.265629593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret") pod "global-pull-secret-syncer-hwc2x" (UID: "26cc39bb-eb04-4021-b504-4615d81e37db") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:44:57.074247 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:57.074227 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7 podName:d9cf686f-c58a-4602-abf4-90fed6e5b644 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:29.074217919 +0000 UTC m=+66.265663442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kbdz7" (UniqueName: "kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7") pod "network-check-target-xwkcb" (UID: "d9cf686f-c58a-4602-abf4-90fed6e5b644") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:44:57.593374 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:57.593343 2573 generic.go:356] "Generic (PLEG): container finished" podID="1f1c9d22-7170-432e-923c-0c54de461627" containerID="f19e897dd2aae1fafd0936a2099ea1124ed9603389f7e3ca7d82e3807f6d31b4" exitCode=0 Jul 16 00:44:57.593771 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:57.593418 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerDied","Data":"f19e897dd2aae1fafd0936a2099ea1124ed9603389f7e3ca7d82e3807f6d31b4"} Jul 16 00:44:57.603962 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:57.603807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:57.707478 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:57.707451 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:58.101209 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.101183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:58.204877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.204841 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:58.275463 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.275437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:58.430657 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.430637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:44:58.430790 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.430733 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:44:58.430790 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.430746 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:44:58.430790 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:58.430753 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hwc2x" podUID="26cc39bb-eb04-4021-b504-4615d81e37db" Jul 16 00:44:58.430896 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:58.430806 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwkcb" podUID="d9cf686f-c58a-4602-abf4-90fed6e5b644" Jul 16 00:44:58.430951 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:58.430903 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:44:58.598606 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.598576 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" event={"ID":"1f1c9d22-7170-432e-923c-0c54de461627","Type":"ContainerStarted","Data":"ca38657a1f7af3ba004916fb427982553243f0f478d186fe3a90c9fe7f179e95"} Jul 16 00:44:58.624732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.624686 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6s5sn" podStartSLOduration=16.108709132 podStartE2EDuration="35.624670004s" totalImagesPullingTime="19.515960872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:58.624509129 +0000 UTC m=+35.815954668" watchObservedRunningTime="2026-07-16 00:44:58.624670004 +0000 UTC m=+35.816115543" Jul 16 00:44:58.750747 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.750725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:58.808634 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:58.808612 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.143033 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.143016 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-126.ec2.internal" event="NodeReady" Jul 16 00:44:59.143158 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.143103 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 00:44:59.189330 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.189306 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hm5zb"] Jul 16 00:44:59.191109 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.191094 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.192673 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.192655 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b46rm"] Jul 16 00:44:59.193370 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.193350 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm4s9\"" Jul 16 00:44:59.193449 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.193356 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 00:44:59.193449 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.193380 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 00:44:59.194186 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.194173 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.197282 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.197261 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 00:44:59.197569 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.197554 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 00:44:59.197839 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.197812 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 00:44:59.197935 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.197891 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ggldt\"" Jul 16 00:44:59.203303 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.203282 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hm5zb"] Jul 16 00:44:59.206574 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.206536 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b46rm"] Jul 16 00:44:59.291451 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.291426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9bff045-b880-4e87-b650-19f6ae287d82-tmp-dir\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.291451 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.291450 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ttp\" (UniqueName: \"kubernetes.io/projected/f9bff045-b880-4e87-b650-19f6ae287d82-kube-api-access-l6ttp\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.291609 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.291479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.291609 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.291497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlmrw\" (UniqueName: \"kubernetes.io/projected/93b30340-afc2-478e-8969-2ae3018a800d-kube-api-access-hlmrw\") pod \"ingress-canary-b46rm\" (UID: \"93b30340-afc2-478e-8969-2ae3018a800d\") " pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.291609 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.291555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93b30340-afc2-478e-8969-2ae3018a800d-cert\") pod \"ingress-canary-b46rm\" (UID: \"93b30340-afc2-478e-8969-2ae3018a800d\") " pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.291609 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.291584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bff045-b880-4e87-b650-19f6ae287d82-config-volume\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.392845 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.392823 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9bff045-b880-4e87-b650-19f6ae287d82-tmp-dir\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.392970 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.392854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ttp\" (UniqueName: \"kubernetes.io/projected/f9bff045-b880-4e87-b650-19f6ae287d82-kube-api-access-l6ttp\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.392970 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.392900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.392970 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.392927 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlmrw\" (UniqueName: \"kubernetes.io/projected/93b30340-afc2-478e-8969-2ae3018a800d-kube-api-access-hlmrw\") pod \"ingress-canary-b46rm\" (UID: \"93b30340-afc2-478e-8969-2ae3018a800d\") " pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.392970 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.392966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93b30340-afc2-478e-8969-2ae3018a800d-cert\") pod \"ingress-canary-b46rm\" (UID: \"93b30340-afc2-478e-8969-2ae3018a800d\") " pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.393195 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.392993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bff045-b880-4e87-b650-19f6ae287d82-config-volume\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.393195 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:59.393047 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:59.393195 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:59.393114 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:44:59.893094796 +0000 UTC m=+37.084540312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:44:59.393356 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.393217 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9bff045-b880-4e87-b650-19f6ae287d82-tmp-dir\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.393621 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.393601 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bff045-b880-4e87-b650-19f6ae287d82-config-volume\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.397136 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.397113 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93b30340-afc2-478e-8969-2ae3018a800d-cert\") pod \"ingress-canary-b46rm\" (UID: \"93b30340-afc2-478e-8969-2ae3018a800d\") " pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.401845 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.401825 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ttp\" (UniqueName: \"kubernetes.io/projected/f9bff045-b880-4e87-b650-19f6ae287d82-kube-api-access-l6ttp\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.401932 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.401858 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlmrw\" (UniqueName: \"kubernetes.io/projected/93b30340-afc2-478e-8969-2ae3018a800d-kube-api-access-hlmrw\") pod \"ingress-canary-b46rm\" (UID: \"93b30340-afc2-478e-8969-2ae3018a800d\") " pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.506949 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.506919 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b46rm" Jul 16 00:44:59.635197 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.635166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b46rm"] Jul 16 00:44:59.638477 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:44:59.638452 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b30340_afc2_478e_8969_2ae3018a800d.slice/crio-c115d18ca4a3c2bbd9dbb8fffc490731f96f5318c43fa4e97a6334a41b78ce13 WatchSource:0}: Error finding container c115d18ca4a3c2bbd9dbb8fffc490731f96f5318c43fa4e97a6334a41b78ce13: Status 404 returned error can't find the container with id c115d18ca4a3c2bbd9dbb8fffc490731f96f5318c43fa4e97a6334a41b78ce13 Jul 16 00:44:59.669721 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.669662 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.771245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.771100 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.896654 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:44:59.896627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:44:59.896775 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:59.896760 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:44:59.896828 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:44:59.896818 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:00.896803323 +0000 UTC m=+38.088248840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:45:00.430131 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.430093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:45:00.430303 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.430093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:45:00.430303 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.430094 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:45:00.433339 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.433321 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:45:00.433919 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.433901 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:45:00.434029 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.433930 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:45:00.434181 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.434162 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48jwq\"" Jul 16 00:45:00.434244 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.434222 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b92gb\"" Jul 16 00:45:00.434299 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.434162 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:45:00.604508 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.604470 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b46rm" event={"ID":"93b30340-afc2-478e-8969-2ae3018a800d","Type":"ContainerStarted","Data":"c115d18ca4a3c2bbd9dbb8fffc490731f96f5318c43fa4e97a6334a41b78ce13"} Jul 16 00:45:00.904863 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:00.904825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:45:00.905363 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:00.905009 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:00.905363 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:00.905092 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:02.905068708 +0000 UTC m=+40.096514225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:45:01.777775 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:01.777744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:02.611122 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:02.611039 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b46rm" event={"ID":"93b30340-afc2-478e-8969-2ae3018a800d","Type":"ContainerStarted","Data":"3026b4bc135c02bf916d3834f9079c4c6c4deb76c006119a90fbb3f6fb0fe056"} Jul 16 00:45:02.629749 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:02.629708 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b46rm" podStartSLOduration=1.433257627 podStartE2EDuration="3.629693348s" totalImagesPullingTime="2.196435721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:02.628638782 +0000 UTC m=+39.820084341" watchObservedRunningTime="2026-07-16 00:45:02.629693348 +0000 UTC m=+39.821138886" Jul 16 00:45:02.918340 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:02.918308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:45:02.918540 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:02.918515 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:02.918622 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:02.918610 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:06.918590084 +0000 UTC m=+44.110035620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:45:06.945407 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:06.945354 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:45:06.945774 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:06.945503 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:06.945774 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:06.945567 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:14.945552124 +0000 UTC m=+52.136997640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:45:13.396460 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:13.396430 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:13.495706 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:13.495679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:13.564003 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:13.563979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:15.003568 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:15.003532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:45:15.003932 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:15.003665 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:15.003932 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:15.003728 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:45:31.003713407 +0000 UTC m=+68.195158925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:45:21.995178 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:21.995147 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:22.052724 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:22.052697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:23.223038 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.223011 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk"] Jul 16 00:45:23.243032 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.243005 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk"] Jul 16 00:45:23.243180 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.243124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.245447 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.245425 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 16 00:45:23.246082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.246058 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 16 00:45:23.246304 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.246142 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 16 00:45:23.246304 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.246201 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 00:45:23.246304 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.246219 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 00:45:23.246304 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.246231 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 00:45:23.246582 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.246528 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 16 00:45:23.257128 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.257110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kbmq\" (UniqueName: \"kubernetes.io/projected/fa526434-8d61-4bf0-b699-03dbedfab80b-kube-api-access-9kbmq\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.257217 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.257135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-ca\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.257217 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.257153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.257217 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.257190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa526434-8d61-4bf0-b699-03dbedfab80b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.257317 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.257294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.257349 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.257320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-hub\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.357717 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.357688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-hub\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.357851 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.357734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kbmq\" (UniqueName: \"kubernetes.io/projected/fa526434-8d61-4bf0-b699-03dbedfab80b-kube-api-access-9kbmq\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.357851 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.357751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-ca\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.357851 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.357766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.357851 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.357794 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa526434-8d61-4bf0-b699-03dbedfab80b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.358039 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.357866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.358550 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.358528 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa526434-8d61-4bf0-b699-03dbedfab80b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.361157 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.361129 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.361249 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.361228 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-ca\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.361307 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.361285 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-hub\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.361307 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.361287 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa526434-8d61-4bf0-b699-03dbedfab80b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.366043 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.366020 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kbmq\" (UniqueName: \"kubernetes.io/projected/fa526434-8d61-4bf0-b699-03dbedfab80b-kube-api-access-9kbmq\") pod \"cluster-proxy-proxy-agent-666db5549c-bhrlk\" (UID: \"fa526434-8d61-4bf0-b699-03dbedfab80b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.562245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.562174 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:45:23.683438 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:23.683406 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk"] Jul 16 00:45:23.686414 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:45:23.686368 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa526434_8d61_4bf0_b699_03dbedfab80b.slice/crio-bbbc6436692b2cf2d69b3aa5b0f1a2303badd1a2a59c1af28fb3934f5cc1245c WatchSource:0}: Error finding container bbbc6436692b2cf2d69b3aa5b0f1a2303badd1a2a59c1af28fb3934f5cc1245c: Status 404 returned error can't find the container with id bbbc6436692b2cf2d69b3aa5b0f1a2303badd1a2a59c1af28fb3934f5cc1245c Jul 16 00:45:24.595072 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:24.595041 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gflb8" Jul 16 00:45:24.662912 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:24.662877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" event={"ID":"fa526434-8d61-4bf0-b699-03dbedfab80b","Type":"ContainerStarted","Data":"bbbc6436692b2cf2d69b3aa5b0f1a2303badd1a2a59c1af28fb3934f5cc1245c"} Jul 16 00:45:24.718186 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:24.718148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:24.818381 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:24.818346 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:27.673291 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:27.673251 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" event={"ID":"fa526434-8d61-4bf0-b699-03dbedfab80b","Type":"ContainerStarted","Data":"b41159a482a235e7e44011bf2dbc358a6a3d6dde989cf6ca52076d8979408845"} Jul 16 00:45:27.673794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:27.673299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" event={"ID":"fa526434-8d61-4bf0-b699-03dbedfab80b","Type":"ContainerStarted","Data":"4cfe33ce9d4635f1a2d624ca9f47f2ce0943147d38d588b987fe59b102114224"} Jul 16 00:45:27.673794 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:27.673315 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" event={"ID":"fa526434-8d61-4bf0-b699-03dbedfab80b","Type":"ContainerStarted","Data":"d2a383991f8d95385c9d96d2aef2209d681b4c0ebeb1b8dfe0f397184b7ce330"} Jul 16 00:45:27.693491 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:27.693446 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" podStartSLOduration=1.175937083 podStartE2EDuration="4.693432037s" totalImagesPullingTime="3.517494954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:27.692625746 +0000 UTC m=+64.884071304" watchObservedRunningTime="2026-07-16 00:45:27.693432037 +0000 UTC m=+64.884877575" Jul 16 00:45:28.019186 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:28.019117 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:28.997463 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:28.997428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:45:29.000133 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.000113 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:45:29.008341 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:29.008320 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:45:29.008447 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:29.008389 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:46:33.008368219 +0000 UTC m=+130.199813736 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : secret "metrics-daemon-secret" not found Jul 16 00:45:29.098493 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.098465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:45:29.098595 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.098559 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:45:29.100938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.100920 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:45:29.101015 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.100946 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:45:29.110570 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.110546 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:45:29.110818 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.110801 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26cc39bb-eb04-4021-b504-4615d81e37db-original-pull-secret\") pod \"global-pull-secret-syncer-hwc2x\" (UID: \"26cc39bb-eb04-4021-b504-4615d81e37db\") " pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:45:29.121759 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.121734 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbdz7\" (UniqueName: \"kubernetes.io/projected/d9cf686f-c58a-4602-abf4-90fed6e5b644-kube-api-access-kbdz7\") pod \"network-check-target-xwkcb\" (UID: \"d9cf686f-c58a-4602-abf4-90fed6e5b644\") " pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:45:29.242176 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.242155 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hwc2x" Jul 16 00:45:29.252798 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.252744 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48jwq\"" Jul 16 00:45:29.261167 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.261154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:45:29.397804 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.397774 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hwc2x"] Jul 16 00:45:29.401237 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:45:29.401205 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cc39bb_eb04_4021_b504_4615d81e37db.slice/crio-fe45b53d0f2d04ad73632e41bf2fcdeaf5c2fc410161ac05353fec6903f6aab2 WatchSource:0}: Error finding container fe45b53d0f2d04ad73632e41bf2fcdeaf5c2fc410161ac05353fec6903f6aab2: Status 404 returned error can't find the container with id fe45b53d0f2d04ad73632e41bf2fcdeaf5c2fc410161ac05353fec6903f6aab2 Jul 16 00:45:29.429823 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.429798 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xwkcb"] Jul 16 00:45:29.432725 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:45:29.432697 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cf686f_c58a_4602_abf4_90fed6e5b644.slice/crio-dccffb658187750b2ed36d8cff570284dfa686505297fc80874d5395cf234529 WatchSource:0}: Error finding container dccffb658187750b2ed36d8cff570284dfa686505297fc80874d5395cf234529: Status 404 returned error can't find the container with id dccffb658187750b2ed36d8cff570284dfa686505297fc80874d5395cf234529 Jul 16 00:45:29.678738 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.678704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xwkcb" event={"ID":"d9cf686f-c58a-4602-abf4-90fed6e5b644","Type":"ContainerStarted","Data":"dccffb658187750b2ed36d8cff570284dfa686505297fc80874d5395cf234529"} Jul 16 00:45:29.679735 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:29.679712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwc2x" event={"ID":"26cc39bb-eb04-4021-b504-4615d81e37db","Type":"ContainerStarted","Data":"fe45b53d0f2d04ad73632e41bf2fcdeaf5c2fc410161ac05353fec6903f6aab2"} Jul 16 00:45:31.012500 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:31.012465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:45:31.012950 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:31.012658 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:45:31.012950 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:45:31.012722 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:46:03.012701606 +0000 UTC m=+100.204147143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:45:34.695515 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:34.695477 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xwkcb" event={"ID":"d9cf686f-c58a-4602-abf4-90fed6e5b644","Type":"ContainerStarted","Data":"2b31f1c701f5ee0617bf223452999cb1c5e79e92fc684b7b338b69c544b33934"} Jul 16 00:45:34.695984 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:34.695616 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:45:34.696944 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:34.696919 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hwc2x" event={"ID":"26cc39bb-eb04-4021-b504-4615d81e37db","Type":"ContainerStarted","Data":"0fc7ae98bae8a7bc0f5044d04fe51261bbc13f5717a493ebd0fcc99e85dffee0"} Jul 16 00:45:34.712968 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:34.712921 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xwkcb" podStartSLOduration=67.262770539 podStartE2EDuration="1m11.712908556s" totalImagesPullingTime="4.450138017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:34.711613358 +0000 UTC m=+71.903058919" watchObservedRunningTime="2026-07-16 00:45:34.712908556 +0000 UTC m=+71.904354073" Jul 16 00:45:34.726303 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:34.726263 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hwc2x" podStartSLOduration=66.241994829 podStartE2EDuration="1m10.726250122s" totalImagesPullingTime="4.484255293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:34.725997377 +0000 UTC m=+71.917442917" watchObservedRunningTime="2026-07-16 00:45:34.726250122 +0000 UTC m=+71.917695661" Jul 16 00:45:53.032330 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:53.032223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:53.090076 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:45:53.090050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:03.015904 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:46:03.015868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:46:03.016322 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:46:03.016002 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:46:03.016322 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:46:03.016059 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:47:07.016045053 +0000 UTC m=+164.207490570 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:46:05.702385 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:46:05.702352 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xwkcb" Jul 16 00:46:33.011730 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:46:33.011684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:46:33.012234 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:46:33.011844 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:46:33.012234 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:46:33.011911 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.011894384 +0000 UTC m=+252.203339901 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : secret "metrics-daemon-secret" not found Jul 16 00:47:02.201071 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:47:02.201033 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hm5zb" podUID="f9bff045-b880-4e87-b650-19f6ae287d82" Jul 16 00:47:02.934798 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:47:02.934760 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hm5zb" Jul 16 00:47:03.456008 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:47:03.455974 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:47:07.035071 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:47:07.035040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:47:07.035470 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:47:07.035130 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:47:07.035470 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:47:07.035184 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls podName:f9bff045-b880-4e87-b650-19f6ae287d82 nodeName:}" failed. No retries permitted until 2026-07-16 00:49:09.035170061 +0000 UTC m=+286.226615577 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls") pod "dns-default-hm5zb" (UID: "f9bff045-b880-4e87-b650-19f6ae287d82") : secret "dns-default-metrics-tls" not found Jul 16 00:47:14.430440 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:47:14.430387 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:48:30.421846 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:30.421804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:30.511491 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:30.511447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:32.502707 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:32.502678 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:32.603823 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:32.603796 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:34.347771 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:34.347738 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:34.409438 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:34.409385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:34.794055 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:34.794024 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:34.858410 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:34.858378 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:35.051386 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.051308 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:35.107551 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.107528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:48:35.107673 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.107659 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:48:35.107720 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.107714 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs podName:c7a433a3-b668-4fed-803f-eb31d9d4e767 nodeName:}" failed. No retries permitted until 2026-07-16 00:50:37.107700337 +0000 UTC m=+374.299145854 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs") pod "network-metrics-daemon-bwp6p" (UID: "c7a433a3-b668-4fed-803f-eb31d9d4e767") : secret "metrics-daemon-secret" not found Jul 16 00:48:35.151920 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.151890 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:35.178377 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.178352 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6dgfc"] Jul 16 00:48:35.180409 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.180374 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.182663 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.182641 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vt48n\"" Jul 16 00:48:35.182802 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.182784 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 00:48:35.182860 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.182851 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 00:48:35.183343 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.183326 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 00:48:35.183470 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.183454 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 00:48:35.190701 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.190680 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6dgfc"] Jul 16 00:48:35.227045 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.227017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:35.308737 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.308674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-crio-socket\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.308737 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.308705 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.308895 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.308778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-data-volume\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.308895 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.308807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.308895 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.308834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkcp7\" (UniqueName: \"kubernetes.io/projected/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-api-access-hkcp7\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410118 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-crio-socket\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410118 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410166 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-data-volume\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkcp7\" (UniqueName: \"kubernetes.io/projected/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-api-access-hkcp7\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410208 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-crio-socket\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.410292 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.410354 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.410370 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.910350211 +0000 UTC m=+253.101795728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : configmap "kube-rbac-proxy" not found Jul 16 00:48:35.410522 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.410447 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:35.910431202 +0000 UTC m=+253.101876724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.410778 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.410548 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-data-volume\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.418659 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.418639 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkcp7\" (UniqueName: \"kubernetes.io/projected/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-api-access-hkcp7\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.913346 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.913309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.913644 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:35.913356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:35.913644 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.913503 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.913644 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.913518 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:35.913644 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.913585 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:36.913564195 +0000 UTC m=+254.105009715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:35.913644 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:35.913605 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:36.913596199 +0000 UTC m=+254.105041718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : configmap "kube-rbac-proxy" not found Jul 16 00:48:36.548802 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.548767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:36.676729 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.676699 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-txg99"] Jul 16 00:48:36.678772 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.678757 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.681732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.681706 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 00:48:36.681855 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.681834 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 00:48:36.682539 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.682519 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bmh5r\"" Jul 16 00:48:36.682621 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.682527 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 00:48:36.685829 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.685812 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 00:48:36.699163 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.699140 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-txg99"] Jul 16 00:48:36.724948 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.724923 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:36.780613 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.780590 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:36.821112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.821067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6sb\" (UniqueName: \"kubernetes.io/projected/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-kube-api-access-7d6sb\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.821112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.821108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-signing-key\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.821203 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.821156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-signing-cabundle\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.921406 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.921374 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-signing-cabundle\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.921514 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.921438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6sb\" (UniqueName: \"kubernetes.io/projected/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-kube-api-access-7d6sb\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.921514 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.921460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:36.921514 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.921486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-signing-key\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.921514 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.921506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:36.921705 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:36.921578 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:36.921705 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:36.921597 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:36.921705 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:36.921638 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:38.92162108 +0000 UTC m=+256.113066599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : configmap "kube-rbac-proxy" not found Jul 16 00:48:36.921705 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:36.921667 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:38.921650402 +0000 UTC m=+256.113095936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:36.922051 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.922033 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-signing-cabundle\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.923908 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.923888 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-signing-key\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.929627 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.929610 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6sb\" (UniqueName: \"kubernetes.io/projected/7ca2c2ce-97a4-4797-999a-0ff63ba5af04-kube-api-access-7d6sb\") pod \"service-ca-79f68b9f4f-txg99\" (UID: \"7ca2c2ce-97a4-4797-999a-0ff63ba5af04\") " pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:36.953713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.953692 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-48qqz_3bf34870-9894-4bbe-97cb-aa1d0f1b056f/dns-node-resolver/0.log" Jul 16 00:48:36.988472 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:36.988451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" Jul 16 00:48:37.116970 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:37.116906 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-txg99"] Jul 16 00:48:37.120425 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:48:37.120382 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca2c2ce_97a4_4797_999a_0ff63ba5af04.slice/crio-514e3e1bfe71705d7031eb77df83bd2e84bac139795fd98e347365c9459ff153 WatchSource:0}: Error finding container 514e3e1bfe71705d7031eb77df83bd2e84bac139795fd98e347365c9459ff153: Status 404 returned error can't find the container with id 514e3e1bfe71705d7031eb77df83bd2e84bac139795fd98e347365c9459ff153 Jul 16 00:48:37.185142 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:37.185105 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" event={"ID":"7ca2c2ce-97a4-4797-999a-0ff63ba5af04","Type":"ContainerStarted","Data":"514e3e1bfe71705d7031eb77df83bd2e84bac139795fd98e347365c9459ff153"} Jul 16 00:48:37.598493 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:37.598459 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:38.153719 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:38.153691 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x5x6g_079acca2-8fc9-4a09-8fbd-2e3b16d32b85/node-ca/0.log" Jul 16 00:48:38.935698 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:38.935656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:38.936104 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:38.935718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:38.936104 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:38.935809 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:38.936104 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:38.935815 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:38.936104 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:38.935858 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:42.935845218 +0000 UTC m=+260.127290735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : configmap "kube-rbac-proxy" not found Jul 16 00:48:38.936104 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:38.935883 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:42.935864981 +0000 UTC m=+260.127310501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:38.956636 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:38.956583 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b46rm_93b30340-afc2-478e-8969-2ae3018a800d/serve-healthcheck-canary/0.log" Jul 16 00:48:39.194108 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:39.194024 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" event={"ID":"7ca2c2ce-97a4-4797-999a-0ff63ba5af04","Type":"ContainerStarted","Data":"2727aafca98afe2501847326ad3c4e9709cd0fde57eae9fee226d4ea0d9bd523"} Jul 16 00:48:39.212848 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:39.212793 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-txg99" podStartSLOduration=1.371663533 podStartE2EDuration="3.21277447s" totalImagesPullingTime="1.841110937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:39.210908538 +0000 UTC m=+256.402354076" watchObservedRunningTime="2026-07-16 00:48:39.21277447 +0000 UTC m=+256.404220010" Jul 16 00:48:39.889836 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:39.889806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.403337 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:40.403298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.571865 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:40.571830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.672718 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:40.672611 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.772898 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:40.772844 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:41.307605 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:41.307566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:41.892423 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:41.892365 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:42.291543 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:42.291454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:42.692603 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:42.692559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:42.965790 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:42.965711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:42.965790 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:42.965785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:42.966155 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:42.965837 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:48:42.966155 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:42.965878 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:48:42.966155 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:42.965906 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:50.96589017 +0000 UTC m=+268.157335689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : configmap "kube-rbac-proxy" not found Jul 16 00:48:42.966155 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:48:42.965923 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls podName:a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7 nodeName:}" failed. No retries permitted until 2026-07-16 00:48:50.965915565 +0000 UTC m=+268.157361082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6dgfc" (UID: "a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7") : secret "insights-runtime-extractor-tls" not found Jul 16 00:48:43.089296 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:43.089242 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:43.288148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:43.288062 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:43.389655 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:43.389621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:43.688910 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:43.688878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:44.096356 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:44.096282 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:44.300430 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:44.300368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:44.374890 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:44.374788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:44.536576 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:44.536541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:44.698087 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:44.698055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:45.094854 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:45.094724 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:45.177744 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:45.177705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:45.308885 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:45.308850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:45.687411 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:45.687369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:46.289875 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:46.289847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:46.893563 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:46.893535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:47.098501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:47.098462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:47.199962 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:47.199885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:47.493564 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:47.493477 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:47.689237 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:47.689200 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:47.890693 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:47.890663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:48.132369 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:48.132339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:48.896067 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:48.896035 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:49.090938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:49.090909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:49.493946 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:49.493910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:49.687827 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:49.687798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:50.093575 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:50.093543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:50.688548 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:50.688521 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:50.898247 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:50.898218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:51.024853 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.024774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:51.024853 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.024836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:51.025291 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.025272 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:51.026994 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.026971 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dgfc\" (UID: \"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7\") " pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:51.089032 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.089006 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:51.089170 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.089036 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6dgfc" Jul 16 00:48:51.210858 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.210828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6dgfc"] Jul 16 00:48:51.215703 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:48:51.215675 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57d8cb9_e46a_4c5f_b8fc_56ef251c31c7.slice/crio-1a3e49bf01b6b325e84a84d8928d2939aba15c4a1c7da21084669fd65d329ffb WatchSource:0}: Error finding container 1a3e49bf01b6b325e84a84d8928d2939aba15c4a1c7da21084669fd65d329ffb: Status 404 returned error can't find the container with id 1a3e49bf01b6b325e84a84d8928d2939aba15c4a1c7da21084669fd65d329ffb Jul 16 00:48:51.226274 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:51.226249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dgfc" event={"ID":"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7","Type":"ContainerStarted","Data":"1a3e49bf01b6b325e84a84d8928d2939aba15c4a1c7da21084669fd65d329ffb"} Jul 16 00:48:54.471731 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.471701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:54.543000 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.542966 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:54.619832 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.619799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:54.776566 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.776480 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-zw9zp"] Jul 16 00:48:54.798592 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.798564 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zw9zp"] Jul 16 00:48:54.798771 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.798678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:48:54.801237 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.801211 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 00:48:54.801730 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.801682 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 00:48:54.802085 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.802063 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hb2bg\"" Jul 16 00:48:54.830360 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.830320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:54.855658 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.855628 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fb966bc88-d4lx7"] Jul 16 00:48:54.860124 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.860104 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.862809 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.862788 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 00:48:54.862931 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.862787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 00:48:54.862931 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.862893 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 00:48:54.863027 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.862998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pkjn\"" Jul 16 00:48:54.869209 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.869188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 00:48:54.877911 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.877889 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fb966bc88-d4lx7"] Jul 16 00:48:54.937495 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.937457 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:54.957733 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.957701 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/851fdf54-bb7d-4e1b-be8c-0251dee4b514-trusted-ca\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.957901 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.957748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-bound-sa-token\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.957901 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.957823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/851fdf54-bb7d-4e1b-be8c-0251dee4b514-image-registry-private-configuration\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.957901 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.957893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/851fdf54-bb7d-4e1b-be8c-0251dee4b514-installation-pull-secrets\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.958074 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.957926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/851fdf54-bb7d-4e1b-be8c-0251dee4b514-ca-trust-extracted\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.958074 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.957966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpmfc\" (UniqueName: \"kubernetes.io/projected/5e50f696-fe89-4519-b7fb-918e1c9bc12c-kube-api-access-vpmfc\") pod \"downloads-68c9cbb497-zw9zp\" (UID: \"5e50f696-fe89-4519-b7fb-918e1c9bc12c\") " pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:48:54.958074 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.958001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfkjd\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-kube-api-access-jfkjd\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.958074 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.958047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-registry-tls\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:54.958266 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:54.958075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/851fdf54-bb7d-4e1b-be8c-0251dee4b514-registry-certificates\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.040429 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.040341 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:55.058481 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/851fdf54-bb7d-4e1b-be8c-0251dee4b514-image-registry-private-configuration\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.058636 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/851fdf54-bb7d-4e1b-be8c-0251dee4b514-installation-pull-secrets\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.058636 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/851fdf54-bb7d-4e1b-be8c-0251dee4b514-ca-trust-extracted\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058819 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpmfc\" (UniqueName: \"kubernetes.io/projected/5e50f696-fe89-4519-b7fb-918e1c9bc12c-kube-api-access-vpmfc\") pod \"downloads-68c9cbb497-zw9zp\" (UID: \"5e50f696-fe89-4519-b7fb-918e1c9bc12c\") " pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfkjd\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-kube-api-access-jfkjd\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/851fdf54-bb7d-4e1b-be8c-0251dee4b514-ca-trust-extracted\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-registry-tls\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.058933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/851fdf54-bb7d-4e1b-be8c-0251dee4b514-registry-certificates\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.059013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/851fdf54-bb7d-4e1b-be8c-0251dee4b514-trusted-ca\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059336 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.059042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-bound-sa-token\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.059915 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.059857 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/851fdf54-bb7d-4e1b-be8c-0251dee4b514-registry-certificates\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.060008 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.059930 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/851fdf54-bb7d-4e1b-be8c-0251dee4b514-trusted-ca\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.061787 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.061744 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/851fdf54-bb7d-4e1b-be8c-0251dee4b514-image-registry-private-configuration\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.061897 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.061798 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-registry-tls\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.061897 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.061867 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/851fdf54-bb7d-4e1b-be8c-0251dee4b514-installation-pull-secrets\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.067665 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.067638 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-bound-sa-token\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.068189 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.068166 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpmfc\" (UniqueName: \"kubernetes.io/projected/5e50f696-fe89-4519-b7fb-918e1c9bc12c-kube-api-access-vpmfc\") pod \"downloads-68c9cbb497-zw9zp\" (UID: \"5e50f696-fe89-4519-b7fb-918e1c9bc12c\") " pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:48:55.068375 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.068330 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfkjd\" (UniqueName: \"kubernetes.io/projected/851fdf54-bb7d-4e1b-be8c-0251dee4b514-kube-api-access-jfkjd\") pod \"image-registry-7fb966bc88-d4lx7\" (UID: \"851fdf54-bb7d-4e1b-be8c-0251dee4b514\") " pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:55.110435 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.110391 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:48:55.170546 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:55.170514 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:56.152435 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.152386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:56.254220 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.254195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:56.326820 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.326793 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zw9zp"] Jul 16 00:48:56.329740 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:48:56.329716 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e50f696_fe89_4519_b7fb_918e1c9bc12c.slice/crio-315ac1f5b88756329a145512f52aa6f10d3af545bec2163f706f8473fbd37fbd WatchSource:0}: Error finding container 315ac1f5b88756329a145512f52aa6f10d3af545bec2163f706f8473fbd37fbd: Status 404 returned error can't find the container with id 315ac1f5b88756329a145512f52aa6f10d3af545bec2163f706f8473fbd37fbd Jul 16 00:48:56.346852 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.346754 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fb966bc88-d4lx7"] Jul 16 00:48:56.350456 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:48:56.350430 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851fdf54_bb7d_4e1b_be8c_0251dee4b514.slice/crio-826532a866434477e8edcb23600d2d45152e8aae19bf6628389d7c7ad0708950 WatchSource:0}: Error finding container 826532a866434477e8edcb23600d2d45152e8aae19bf6628389d7c7ad0708950: Status 404 returned error can't find the container with id 826532a866434477e8edcb23600d2d45152e8aae19bf6628389d7c7ad0708950 Jul 16 00:48:56.355049 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.355023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:56.426387 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.426362 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:56.557355 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:56.557321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:57.002853 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.002814 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:57.252219 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.252131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dgfc" event={"ID":"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7","Type":"ContainerStarted","Data":"808956c107300f2f6c9fa54d4f12fec20992d36ecd0291f79b39419f689de5a8"} Jul 16 00:48:57.254125 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.254041 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zw9zp" event={"ID":"5e50f696-fe89-4519-b7fb-918e1c9bc12c","Type":"ContainerStarted","Data":"315ac1f5b88756329a145512f52aa6f10d3af545bec2163f706f8473fbd37fbd"} Jul 16 00:48:57.256045 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.256023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" event={"ID":"851fdf54-bb7d-4e1b-be8c-0251dee4b514","Type":"ContainerStarted","Data":"6ce2656046fa84a4f722e18c6a4528ffa0c9073ea6db2aaef1a288036e208916"} Jul 16 00:48:57.256149 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.256059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" event={"ID":"851fdf54-bb7d-4e1b-be8c-0251dee4b514","Type":"ContainerStarted","Data":"826532a866434477e8edcb23600d2d45152e8aae19bf6628389d7c7ad0708950"} Jul 16 00:48:57.256202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.256182 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:48:57.282246 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.282187 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" podStartSLOduration=3.282169365 podStartE2EDuration="3.282169365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:57.281653349 +0000 UTC m=+274.473098891" watchObservedRunningTime="2026-07-16 00:48:57.282169365 +0000 UTC m=+274.473614906" Jul 16 00:48:57.603390 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.603246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:57.716905 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:57.716864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:58.974606 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:48:58.974480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:00.268086 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:00.268051 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dgfc" event={"ID":"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7","Type":"ContainerStarted","Data":"3a193eb7c9f091d8067a3a1fc6c157f4effcc7acba8e66e51d020de4846d7e2b"} Jul 16 00:49:02.077436 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:02.077385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:02.177443 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:02.177388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:02.238729 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:02.238695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:04.283889 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:04.283854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dgfc" event={"ID":"a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7","Type":"ContainerStarted","Data":"956cfb3c682fdb390806e8d1a2c087d77fce8f7134e2adc2c06b90a8643b5ede"} Jul 16 00:49:04.305848 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:04.305787 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6dgfc" podStartSLOduration=16.509224972 podStartE2EDuration="29.305767182s" totalImagesPullingTime="12.79654221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:48:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:04.305053186 +0000 UTC m=+281.496498743" watchObservedRunningTime="2026-07-16 00:49:04.305767182 +0000 UTC m=+281.497212722" Jul 16 00:49:05.520379 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:05.520342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:05.671968 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:05.671934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:05.882924 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:05.882888 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:05.935970 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:49:05.935932 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hm5zb" podUID="f9bff045-b880-4e87-b650-19f6ae287d82" Jul 16 00:49:06.291342 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:06.291272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hm5zb" Jul 16 00:49:07.435857 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:07.435826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:07.505044 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:07.505008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:08.735807 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:08.735761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:08.812244 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:08.812201 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:09.057808 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:09.057734 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:09.073744 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:09.073710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:49:09.076239 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:09.076210 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bff045-b880-4e87-b650-19f6ae287d82-metrics-tls\") pod \"dns-default-hm5zb\" (UID: \"f9bff045-b880-4e87-b650-19f6ae287d82\") " pod="openshift-dns/dns-default-hm5zb" Jul 16 00:49:09.295495 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:09.295466 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zm4s9\"" Jul 16 00:49:09.303139 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:09.303113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hm5zb" Jul 16 00:49:11.551602 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:11.551562 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:12.867911 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:12.867859 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.087302 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.087234 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.128342 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.128281 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pg2cf"] Jul 16 00:49:13.159125 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.159097 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d2l8s"] Jul 16 00:49:13.159266 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.159202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.162930 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.162571 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 00:49:13.162930 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.162652 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 00:49:13.162930 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.162858 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 00:49:13.162930 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.162871 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 00:49:13.163216 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.162874 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 00:49:13.163216 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.162975 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 00:49:13.163216 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.163202 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w5sbz\"" Jul 16 00:49:13.170118 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.170095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.182100 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.182079 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pg2cf"] Jul 16 00:49:13.182225 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.182204 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.184289 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.184254 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 00:49:13.184725 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.184570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 00:49:13.185198 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.184917 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6mwtn\"" Jul 16 00:49:13.185198 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.185070 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 00:49:13.204790 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.204899 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204803 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-tls\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.204899 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-sys\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.204899 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5e437cc4-d28d-48e5-b716-52bf54372ca9-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.205062 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.205062 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-root\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.205062 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-wtmp\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.205062 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.204991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gz92\" (UniqueName: \"kubernetes.io/projected/859f47cd-4838-4be3-9057-ff0fee58f0b2-kube-api-access-9gz92\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.205062 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.205280 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.205280 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-textfile\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.205280 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/859f47cd-4838-4be3-9057-ff0fee58f0b2-metrics-client-ca\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.205280 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205209 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e437cc4-d28d-48e5-b716-52bf54372ca9-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.205446 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5rsw\" (UniqueName: \"kubernetes.io/projected/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-api-access-r5rsw\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.205446 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.205317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.232488 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.232385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.308518 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e437cc4-d28d-48e5-b716-52bf54372ca9-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.308518 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5rsw\" (UniqueName: \"kubernetes.io/projected/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-api-access-r5rsw\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308596 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-tls\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-sys\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5e437cc4-d28d-48e5-b716-52bf54372ca9-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.308767 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-root\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.309202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-wtmp\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.309202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gz92\" (UniqueName: \"kubernetes.io/projected/859f47cd-4838-4be3-9057-ff0fee58f0b2-kube-api-access-9gz92\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.309202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.309202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.309202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-textfile\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.309202 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.308934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/859f47cd-4838-4be3-9057-ff0fee58f0b2-metrics-client-ca\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.309714 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e437cc4-d28d-48e5-b716-52bf54372ca9-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:49:13.309835 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:49:13.309939 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-tls podName:859f47cd-4838-4be3-9057-ff0fee58f0b2 nodeName:}" failed. No retries permitted until 2026-07-16 00:49:13.809921145 +0000 UTC m=+291.001366662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-tls") pod "node-exporter-d2l8s" (UID: "859f47cd-4838-4be3-9057-ff0fee58f0b2") : secret "node-exporter-tls" not found Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.309983 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/859f47cd-4838-4be3-9057-ff0fee58f0b2-metrics-client-ca\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.310064 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-root\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.310231 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-wtmp\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.310424 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/859f47cd-4838-4be3-9057-ff0fee58f0b2-sys\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.310519 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.310955 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311245 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.311178 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-textfile\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.311849 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.311591 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5e437cc4-d28d-48e5-b716-52bf54372ca9-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.315507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.315024 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.315507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.315028 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.315507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.315390 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.318704 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.318670 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gz92\" (UniqueName: \"kubernetes.io/projected/859f47cd-4838-4be3-9057-ff0fee58f0b2-kube-api-access-9gz92\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.329442 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.329071 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5rsw\" (UniqueName: \"kubernetes.io/projected/5e437cc4-d28d-48e5-b716-52bf54372ca9-kube-api-access-r5rsw\") pod \"kube-state-metrics-785778ff74-pg2cf\" (UID: \"5e437cc4-d28d-48e5-b716-52bf54372ca9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.333006 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.332982 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.354604 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.354581 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hm5zb"] Jul 16 00:49:13.359771 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:49:13.359740 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bff045_b880_4e87_b650_19f6ae287d82.slice/crio-90afed7e26345c91b50c24f5eb56952515184ea3b550dfd5dc946fd3cf8e3b10 WatchSource:0}: Error finding container 90afed7e26345c91b50c24f5eb56952515184ea3b550dfd5dc946fd3cf8e3b10: Status 404 returned error can't find the container with id 90afed7e26345c91b50c24f5eb56952515184ea3b550dfd5dc946fd3cf8e3b10 Jul 16 00:49:13.415701 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.415677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.469533 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.469507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" Jul 16 00:49:13.475928 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.475884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.586141 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.586042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.622091 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.621835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pg2cf"] Jul 16 00:49:13.626856 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:49:13.626808 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e437cc4_d28d_48e5_b716_52bf54372ca9.slice/crio-58540ed1c9863493d0eca9ecba6d96ff275375cff3b849da5b204588fec51721 WatchSource:0}: Error finding container 58540ed1c9863493d0eca9ecba6d96ff275375cff3b849da5b204588fec51721: Status 404 returned error can't find the container with id 58540ed1c9863493d0eca9ecba6d96ff275375cff3b849da5b204588fec51721 Jul 16 00:49:13.686278 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.686183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.813710 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.813674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-tls\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.816536 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.816511 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/859f47cd-4838-4be3-9057-ff0fee58f0b2-node-exporter-tls\") pod \"node-exporter-d2l8s\" (UID: \"859f47cd-4838-4be3-9057-ff0fee58f0b2\") " pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:13.830130 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.830098 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:13.932906 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:13.932875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.093849 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.093563 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d2l8s" Jul 16 00:49:14.097725 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.097660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.226314 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.226155 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.323353 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.323137 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zw9zp" event={"ID":"5e50f696-fe89-4519-b7fb-918e1c9bc12c","Type":"ContainerStarted","Data":"0152c17a979a883666fb3fc83fd0d7ec402b2ec04abcc4697bab3f309d0f81a3"} Jul 16 00:49:14.328546 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.328231 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:49:14.334056 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.333365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2l8s" event={"ID":"859f47cd-4838-4be3-9057-ff0fee58f0b2","Type":"ContainerStarted","Data":"95b77c7b5f39916e2cd1f575475716326afda360c2fc219dc67fbfd6c4186e6b"} Jul 16 00:49:14.336448 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.336171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" event={"ID":"5e437cc4-d28d-48e5-b716-52bf54372ca9","Type":"ContainerStarted","Data":"58540ed1c9863493d0eca9ecba6d96ff275375cff3b849da5b204588fec51721"} Jul 16 00:49:14.338332 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.338299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hm5zb" event={"ID":"f9bff045-b880-4e87-b650-19f6ae287d82","Type":"ContainerStarted","Data":"90afed7e26345c91b50c24f5eb56952515184ea3b550dfd5dc946fd3cf8e3b10"} Jul 16 00:49:14.339540 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.339509 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-zw9zp" Jul 16 00:49:14.376744 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.376054 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-zw9zp" podStartSLOduration=3.2949176270000002 podStartE2EDuration="20.376035898s" totalImagesPullingTime="17.081118271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:14.375672507 +0000 UTC m=+291.567118047" watchObservedRunningTime="2026-07-16 00:49:14.376035898 +0000 UTC m=+291.567481440" Jul 16 00:49:14.418652 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.418618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.518354 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:14.518120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:15.177053 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:15.177012 2573 patch_prober.go:28] interesting pod/image-registry-7fb966bc88-d4lx7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 00:49:15.177551 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:15.177076 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" podUID="851fdf54-bb7d-4e1b-be8c-0251dee4b514" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:49:16.074086 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.074052 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:16.112549 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.112516 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv"] Jul 16 00:49:16.137114 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.136553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv"] Jul 16 00:49:16.137114 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.136713 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.140085 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.140321 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.140524 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cb9kte35mh2dk\"" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.140685 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.140888 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8pjpj\"" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.141078 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 00:49:16.141975 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.141259 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 00:49:16.175440 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.175344 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:16.238659 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-grpc-tls\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.238659 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.239588 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.239588 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.239588 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-tls\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.239588 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238803 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98a044ea-22d8-43ff-b53d-fba37f2cd513-metrics-client-ca\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.239588 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkc7j\" (UniqueName: \"kubernetes.io/projected/98a044ea-22d8-43ff-b53d-fba37f2cd513-kube-api-access-kkc7j\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.239588 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.238866 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339422 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339422 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339475 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-tls\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98a044ea-22d8-43ff-b53d-fba37f2cd513-metrics-client-ca\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkc7j\" (UniqueName: \"kubernetes.io/projected/98a044ea-22d8-43ff-b53d-fba37f2cd513-kube-api-access-kkc7j\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.339648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.339561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-grpc-tls\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.340535 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.340484 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98a044ea-22d8-43ff-b53d-fba37f2cd513-metrics-client-ca\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.343008 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.342849 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.344921 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.343507 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.344921 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.343916 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.344921 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.344326 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-tls\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.344921 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.344749 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-grpc-tls\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.345192 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.345086 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98a044ea-22d8-43ff-b53d-fba37f2cd513-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.351102 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.351069 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkc7j\" (UniqueName: \"kubernetes.io/projected/98a044ea-22d8-43ff-b53d-fba37f2cd513-kube-api-access-kkc7j\") pod \"thanos-querier-6fd5b8d595-k7dwv\" (UID: \"98a044ea-22d8-43ff-b53d-fba37f2cd513\") " pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:16.412213 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.412182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:16.451220 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:16.451197 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:17.011149 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.010910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv"] Jul 16 00:49:17.016281 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:49:17.016249 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a044ea_22d8_43ff_b53d_fba37f2cd513.slice/crio-9502cf3a4542fb8100aa101f5de22e3b065a0359cc6fd9954a0d7b37ccf3003d WatchSource:0}: Error finding container 9502cf3a4542fb8100aa101f5de22e3b065a0359cc6fd9954a0d7b37ccf3003d: Status 404 returned error can't find the container with id 9502cf3a4542fb8100aa101f5de22e3b065a0359cc6fd9954a0d7b37ccf3003d Jul 16 00:49:17.022191 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.022167 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:17.354032 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.353964 2573 generic.go:356] "Generic (PLEG): container finished" podID="859f47cd-4838-4be3-9057-ff0fee58f0b2" containerID="1b8d713b1951e0ae9b8da3f09c4d64b6844fcbd776f4cbded57468f83cd8f8e6" exitCode=0 Jul 16 00:49:17.354478 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.354059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2l8s" event={"ID":"859f47cd-4838-4be3-9057-ff0fee58f0b2","Type":"ContainerDied","Data":"1b8d713b1951e0ae9b8da3f09c4d64b6844fcbd776f4cbded57468f83cd8f8e6"} Jul 16 00:49:17.356938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.356804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" event={"ID":"5e437cc4-d28d-48e5-b716-52bf54372ca9","Type":"ContainerStarted","Data":"10d4c20ed915ea5793cdceff3d3be8121f8fc609188f801d1205e1354434e20b"} Jul 16 00:49:17.356938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.356865 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" event={"ID":"5e437cc4-d28d-48e5-b716-52bf54372ca9","Type":"ContainerStarted","Data":"99d9243760b9b615d7793030e0fc12c7f30358ee687dc115f36d624a34f0771a"} Jul 16 00:49:17.356938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.356900 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" event={"ID":"5e437cc4-d28d-48e5-b716-52bf54372ca9","Type":"ContainerStarted","Data":"ca54a16411b5c2b52290bd627623c0a0148b163bb0f7360122c3a1d28bf32675"} Jul 16 00:49:17.361622 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.361597 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hm5zb" event={"ID":"f9bff045-b880-4e87-b650-19f6ae287d82","Type":"ContainerStarted","Data":"51bf8958068e78b1de418d402bd4e96c11e39a351cab057f738f41e0ede7d5f7"} Jul 16 00:49:17.361735 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.361643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hm5zb" event={"ID":"f9bff045-b880-4e87-b650-19f6ae287d82","Type":"ContainerStarted","Data":"2a564bdf02ad62a066cd66a6f3e84e45037a90a82f83569aac057ef21d3f8001"} Jul 16 00:49:17.361735 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.361714 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hm5zb" Jul 16 00:49:17.363529 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.363507 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"9502cf3a4542fb8100aa101f5de22e3b065a0359cc6fd9954a0d7b37ccf3003d"} Jul 16 00:49:17.430894 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:49:17.430861 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bwp6p" podUID="c7a433a3-b668-4fed-803f-eb31d9d4e767" Jul 16 00:49:17.445543 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.445375 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hm5zb" podStartSLOduration=254.997664367 podStartE2EDuration="4m18.445352031s" totalImagesPullingTime="3.447687664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:17.418698496 +0000 UTC m=+294.610144039" watchObservedRunningTime="2026-07-16 00:49:17.445352031 +0000 UTC m=+294.636797571" Jul 16 00:49:17.446000 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.445959 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-pg2cf" podStartSLOduration=1.269989989 podStartE2EDuration="4.445939161s" totalImagesPullingTime="3.175949172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:17.443617018 +0000 UTC m=+294.635062559" watchObservedRunningTime="2026-07-16 00:49:17.445939161 +0000 UTC m=+294.637384701" Jul 16 00:49:17.635233 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.635203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:17.882055 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.882023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:17.981426 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:17.980527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:18.158654 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.158571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:18.266642 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.266613 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fb966bc88-d4lx7" Jul 16 00:49:18.367061 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.367031 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-756c7977bf-hnmxb"] Jul 16 00:49:18.385508 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.385470 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2l8s" event={"ID":"859f47cd-4838-4be3-9057-ff0fee58f0b2","Type":"ContainerStarted","Data":"5f9348444a711e48314ea36361271a7040d5283913a256f227567d16dff7047a"} Jul 16 00:49:18.385672 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.385528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d2l8s" event={"ID":"859f47cd-4838-4be3-9057-ff0fee58f0b2","Type":"ContainerStarted","Data":"a6bfc5b5238c403f1a6945bffda2f66b325a4c8f7f6c95b0fec072633257dd47"} Jul 16 00:49:18.385672 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.385611 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.391535 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.390722 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 00:49:18.391535 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.390769 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 00:49:18.391535 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.391433 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 00:49:18.393721 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.391594 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 00:49:18.393721 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.391693 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qtjt8\"" Jul 16 00:49:18.393721 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.393294 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 00:49:18.394353 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.394286 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756c7977bf-hnmxb"] Jul 16 00:49:18.397785 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.397734 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 00:49:18.403980 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.403930 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d2l8s" podStartSLOduration=2.558155128 podStartE2EDuration="5.403911558s" totalImagesPullingTime="2.69160495s" totalInitContainerRuntime="154.15148ms" isStatefulPod=true podCreationTimestamp="2026-07-16 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:18.402345345 +0000 UTC m=+295.593790909" watchObservedRunningTime="2026-07-16 00:49:18.403911558 +0000 UTC m=+295.595357099" Jul 16 00:49:18.462859 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.462753 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:18.471121 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471086 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-telemeter-client-tls\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.471280 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-serving-certs-ca-bundle\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.471669 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.471669 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-federate-client-tls\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.471669 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zlph\" (UniqueName: \"kubernetes.io/projected/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-kube-api-access-8zlph\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.471669 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-secret-telemeter-client\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.472065 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.471839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.472177 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.472156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-metrics-client-ca\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.562107 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.562062 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:18.573222 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-federate-client-tls\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zlph\" (UniqueName: \"kubernetes.io/projected/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-kube-api-access-8zlph\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-secret-telemeter-client\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-metrics-client-ca\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573447 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-telemeter-client-tls\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.573777 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.573508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-serving-certs-ca-bundle\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.574651 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.574590 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-metrics-client-ca\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.574787 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.574571 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-serving-certs-ca-bundle\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.574898 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.574880 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.577901 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.577875 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-telemeter-client-tls\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.578452 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.578425 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.578901 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.578867 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-secret-telemeter-client\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.579238 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.579217 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-federate-client-tls\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.583003 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.582979 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zlph\" (UniqueName: \"kubernetes.io/projected/f0837fb5-d00c-4f1e-8392-e9036dec8a3d-kube-api-access-8zlph\") pod \"telemeter-client-756c7977bf-hnmxb\" (UID: \"f0837fb5-d00c-4f1e-8392-e9036dec8a3d\") " pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.662750 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.662710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:18.706067 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.706034 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" Jul 16 00:49:18.763261 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:18.763181 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:19.147828 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:19.147740 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756c7977bf-hnmxb"] Jul 16 00:49:19.150706 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:49:19.150675 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0837fb5_d00c_4f1e_8392_e9036dec8a3d.slice/crio-e16e6798ff2cf41dac20f13a63fd588947b346e87c3e2c874ea587fb97145774 WatchSource:0}: Error finding container e16e6798ff2cf41dac20f13a63fd588947b346e87c3e2c874ea587fb97145774: Status 404 returned error can't find the container with id e16e6798ff2cf41dac20f13a63fd588947b346e87c3e2c874ea587fb97145774 Jul 16 00:49:19.330022 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:19.329943 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:19.378264 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:19.378234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" event={"ID":"f0837fb5-d00c-4f1e-8392-e9036dec8a3d","Type":"ContainerStarted","Data":"e16e6798ff2cf41dac20f13a63fd588947b346e87c3e2c874ea587fb97145774"} Jul 16 00:49:19.424327 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:19.424282 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:19.534480 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:19.534426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:20.017755 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.017719 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ccbf47b65-4wwbf"] Jul 16 00:49:20.040799 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.038045 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccbf47b65-4wwbf"] Jul 16 00:49:20.040799 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.038428 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.041768 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.041454 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 00:49:20.042170 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.042144 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 00:49:20.042430 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.042372 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2sqss\"" Jul 16 00:49:20.043629 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.043605 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 00:49:20.047034 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.043828 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 00:49:20.047034 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.044078 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 00:49:20.050130 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.050091 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 00:49:20.087143 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087027 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-trusted-ca-bundle\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.087143 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-oauth-serving-cert\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.087143 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzr9x\" (UniqueName: \"kubernetes.io/projected/14f10583-c058-484d-8317-8fdf04d2a96d-kube-api-access-fzr9x\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.087143 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-serving-cert\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.087512 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-service-ca\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.087512 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-console-config\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.087512 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.087274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-oauth-config\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.187878 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.187827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-oauth-config\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.187908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-trusted-ca-bundle\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.187929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-oauth-serving-cert\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.187959 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzr9x\" (UniqueName: \"kubernetes.io/projected/14f10583-c058-484d-8317-8fdf04d2a96d-kube-api-access-fzr9x\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.187981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-serving-cert\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.188029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-service-ca\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188082 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.188058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-console-config\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.188858 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.188833 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-console-config\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.191078 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.190313 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-trusted-ca-bundle\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.202732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.191379 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-oauth-serving-cert\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.202732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.192542 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-oauth-config\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.202732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.192840 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-service-ca\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.202732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.199300 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzr9x\" (UniqueName: \"kubernetes.io/projected/14f10583-c058-484d-8317-8fdf04d2a96d-kube-api-access-fzr9x\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.202732 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.202105 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-serving-cert\") pod \"console-6ccbf47b65-4wwbf\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.359549 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.359285 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:20.387378 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.387206 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"0cfa1a77c72e209f491671c9a12d7948d0264db29758c5dd70a3ecdab1b68c9b"} Jul 16 00:49:20.387378 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.387285 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"ffd94f1e86bf073b5adaf9c11bb764bece39962814d95f2dd5964cebd005aa2f"} Jul 16 00:49:20.387378 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.387327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"a6f23bafe67111f13af60160ec4f88b1726a741ae9eb357d29a7f62a9a463de2"} Jul 16 00:49:20.557060 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:20.557029 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccbf47b65-4wwbf"] Jul 16 00:49:20.679476 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:49:20.679434 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f10583_c058_484d_8317_8fdf04d2a96d.slice/crio-97c31c617195a50c51adae406e864827d20648bc7b475ba7392a001004846506 WatchSource:0}: Error finding container 97c31c617195a50c51adae406e864827d20648bc7b475ba7392a001004846506: Status 404 returned error can't find the container with id 97c31c617195a50c51adae406e864827d20648bc7b475ba7392a001004846506 Jul 16 00:49:21.272007 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:21.271969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:21.369827 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:21.369731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:21.393097 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:21.393015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf47b65-4wwbf" event={"ID":"14f10583-c058-484d-8317-8fdf04d2a96d","Type":"ContainerStarted","Data":"97c31c617195a50c51adae406e864827d20648bc7b475ba7392a001004846506"} Jul 16 00:49:22.400787 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:22.400749 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"d58132faa1423f5965c99ec5d5630a17432c3a57cf75131c18e3cfccf60802a8"} Jul 16 00:49:22.401275 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:22.400837 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:22.401275 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:22.400875 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"b3af26ee91774f00b8db1f735b75c42c94ac372189562424cbf55c5e0845fd8c"} Jul 16 00:49:22.401275 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:22.400913 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" event={"ID":"98a044ea-22d8-43ff-b53d-fba37f2cd513","Type":"ContainerStarted","Data":"c8c68d41bb7a8ca683fb7cdf8fccdc0fbcee329c978569bc765795b23e2c1cbe"} Jul 16 00:49:22.402362 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:22.402330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" event={"ID":"f0837fb5-d00c-4f1e-8392-e9036dec8a3d","Type":"ContainerStarted","Data":"79fc7b569c3779c4421b5c5f6e2ce594b95007296e073448457e941e6d9cf480"} Jul 16 00:49:22.436093 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:22.435965 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" podStartSLOduration=2.164871876 podStartE2EDuration="6.435947127s" totalImagesPullingTime="4.271075251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:22.434228174 +0000 UTC m=+299.625673727" watchObservedRunningTime="2026-07-16 00:49:22.435947127 +0000 UTC m=+299.627392669" Jul 16 00:49:23.381337 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:23.381302 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:23.438816 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:23.438788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:23.563318 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:23.563274 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" podUID="fa526434-8d61-4bf0-b699-03dbedfab80b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 00:49:24.841701 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:24.841672 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:49:24.842799 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:24.842782 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:49:24.848320 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:24.848301 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 00:49:25.415323 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:25.415289 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" event={"ID":"f0837fb5-d00c-4f1e-8392-e9036dec8a3d","Type":"ContainerStarted","Data":"338e7261bc38d51d48ed24fc3783cdfe267df356ccc118b2aa54aeaf17ddf81f"} Jul 16 00:49:25.415535 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:25.415387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" event={"ID":"f0837fb5-d00c-4f1e-8392-e9036dec8a3d","Type":"ContainerStarted","Data":"e5c1765aa7a5830c7f2537d95ef17e83c160eb6f4309ae64de9f2a970c291df6"} Jul 16 00:49:25.416701 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:25.416677 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf47b65-4wwbf" event={"ID":"14f10583-c058-484d-8317-8fdf04d2a96d","Type":"ContainerStarted","Data":"78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8"} Jul 16 00:49:25.441311 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:25.441268 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-756c7977bf-hnmxb" podStartSLOduration=1.8996071890000001 podStartE2EDuration="7.441254299s" totalImagesPullingTime="5.54164711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:25.439017229 +0000 UTC m=+302.630462798" watchObservedRunningTime="2026-07-16 00:49:25.441254299 +0000 UTC m=+302.632699862" Jul 16 00:49:25.458127 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:25.458082 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ccbf47b65-4wwbf" podStartSLOduration=2.317606671 podStartE2EDuration="6.458070777s" totalImagesPullingTime="4.140464106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:25.457370792 +0000 UTC m=+302.648816341" watchObservedRunningTime="2026-07-16 00:49:25.458070777 +0000 UTC m=+302.649516315" Jul 16 00:49:26.112370 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:26.112336 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccbf47b65-4wwbf"] Jul 16 00:49:27.375235 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:27.375204 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hm5zb" Jul 16 00:49:27.523753 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:27.523706 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:27.585057 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:27.585026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:28.413511 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:28.413481 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fd5b8d595-k7dwv" Jul 16 00:49:28.430071 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:28.430045 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:49:30.359770 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:30.359734 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:31.227305 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:31.227277 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:31.286818 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:31.286790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:33.563956 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:33.563914 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" podUID="fa526434-8d61-4bf0-b699-03dbedfab80b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 00:49:35.171660 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:35.171602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:35.272449 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:35.272406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:36.925541 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:36.925493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:37.027204 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:37.027173 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:37.133635 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:37.133606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:37.232933 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:37.232862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:39.197550 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:39.197519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:39.272019 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:39.271981 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:40.320268 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:40.320221 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:40.384660 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:40.384632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:42.602140 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:42.602107 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:42.658448 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:42.658414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:43.564139 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:43.564103 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" podUID="fa526434-8d61-4bf0-b699-03dbedfab80b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 00:49:43.564286 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:43.564165 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" Jul 16 00:49:43.564645 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:43.564615 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b41159a482a235e7e44011bf2dbc358a6a3d6dde989cf6ca52076d8979408845"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 16 00:49:43.564689 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:43.564666 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" podUID="fa526434-8d61-4bf0-b699-03dbedfab80b" containerName="service-proxy" containerID="cri-o://b41159a482a235e7e44011bf2dbc358a6a3d6dde989cf6ca52076d8979408845" gracePeriod=30 Jul 16 00:49:44.481837 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:44.481803 2573 generic.go:356] "Generic (PLEG): container finished" podID="fa526434-8d61-4bf0-b699-03dbedfab80b" containerID="b41159a482a235e7e44011bf2dbc358a6a3d6dde989cf6ca52076d8979408845" exitCode=2 Jul 16 00:49:44.481837 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:44.481834 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" event={"ID":"fa526434-8d61-4bf0-b699-03dbedfab80b","Type":"ContainerDied","Data":"b41159a482a235e7e44011bf2dbc358a6a3d6dde989cf6ca52076d8979408845"} Jul 16 00:49:44.482255 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:44.481870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-666db5549c-bhrlk" event={"ID":"fa526434-8d61-4bf0-b699-03dbedfab80b","Type":"ContainerStarted","Data":"72e8de49d6a5803ed476f55efb59c5199658ce4a86accc7eca8f4980b65b86c2"} Jul 16 00:49:52.444129 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.444083 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ccbf47b65-4wwbf" podUID="14f10583-c058-484d-8317-8fdf04d2a96d" containerName="console" containerID="cri-o://78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8" gracePeriod=15 Jul 16 00:49:52.722239 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.722177 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:52.854333 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854304 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-trusted-ca-bundle\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854343 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-console-config\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854371 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-serving-cert\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854428 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzr9x\" (UniqueName: \"kubernetes.io/projected/14f10583-c058-484d-8317-8fdf04d2a96d-kube-api-access-fzr9x\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854469 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-service-ca\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854502 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-oauth-serving-cert\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854528 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854525 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-oauth-config\") pod \"14f10583-c058-484d-8317-8fdf04d2a96d\" (UID: \"14f10583-c058-484d-8317-8fdf04d2a96d\") " Jul 16 00:49:52.854818 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854711 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-console-config" (OuterVolumeSpecName: "console-config") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:52.854818 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854798 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:52.854924 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854820 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-console-config\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:52.854924 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854824 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:52.854924 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.854863 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-service-ca" (OuterVolumeSpecName: "service-ca") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:52.856744 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.856718 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:49:52.856871 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.856789 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:49:52.856871 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.856801 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f10583-c058-484d-8317-8fdf04d2a96d-kube-api-access-fzr9x" (OuterVolumeSpecName: "kube-api-access-fzr9x") pod "14f10583-c058-484d-8317-8fdf04d2a96d" (UID: "14f10583-c058-484d-8317-8fdf04d2a96d"). InnerVolumeSpecName "kube-api-access-fzr9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:52.955319 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.955293 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-trusted-ca-bundle\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:52.955319 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.955314 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-serving-cert\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:52.955480 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.955324 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzr9x\" (UniqueName: \"kubernetes.io/projected/14f10583-c058-484d-8317-8fdf04d2a96d-kube-api-access-fzr9x\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:52.955480 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.955334 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-service-ca\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:52.955480 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.955343 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f10583-c058-484d-8317-8fdf04d2a96d-oauth-serving-cert\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:52.955480 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:52.955352 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f10583-c058-484d-8317-8fdf04d2a96d-console-oauth-config\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:49:53.517017 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.516982 2573 generic.go:356] "Generic (PLEG): container finished" podID="14f10583-c058-484d-8317-8fdf04d2a96d" containerID="78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8" exitCode=0 Jul 16 00:49:53.517415 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.517025 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccbf47b65-4wwbf" Jul 16 00:49:53.517415 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.517068 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf47b65-4wwbf" event={"ID":"14f10583-c058-484d-8317-8fdf04d2a96d","Type":"ContainerDied","Data":"78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8"} Jul 16 00:49:53.517415 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.517116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccbf47b65-4wwbf" event={"ID":"14f10583-c058-484d-8317-8fdf04d2a96d","Type":"ContainerDied","Data":"97c31c617195a50c51adae406e864827d20648bc7b475ba7392a001004846506"} Jul 16 00:49:53.517415 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.517138 2573 scope.go:117] "RemoveContainer" containerID="78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8" Jul 16 00:49:53.533672 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.533654 2573 scope.go:117] "RemoveContainer" containerID="78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8" Jul 16 00:49:53.533934 ip-10-0-138-126 kubenswrapper[2573]: E0716 00:49:53.533912 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8\": container with ID starting with 78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8 not found: ID does not exist" containerID="78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8" Jul 16 00:49:53.533981 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.533942 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8"} err="failed to get container status \"78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8\": rpc error: code = NotFound desc = could not find container \"78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8\": container with ID starting with 78af691bd720d0b76cc150f4ab438d8d9e33b8c8109eee9cf7011c51c3f609b8 not found: ID does not exist" Jul 16 00:49:53.534456 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.534439 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccbf47b65-4wwbf"] Jul 16 00:49:53.538020 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:53.537998 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ccbf47b65-4wwbf"] Jul 16 00:49:55.435262 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:55.435229 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f10583-c058-484d-8317-8fdf04d2a96d" path="/var/lib/kubelet/pods/14f10583-c058-484d-8317-8fdf04d2a96d/volumes" Jul 16 00:49:57.609603 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:57.609572 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:57.671091 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:49:57.671058 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:27.458581 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:27.458548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:27.533661 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:27.533631 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:29.251540 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:29.251507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:29.351371 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:29.351338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:34.020218 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:34.020188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:34.084212 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:34.084185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:37.188141 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.188093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:50:37.190536 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.190512 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7a433a3-b668-4fed-803f-eb31d9d4e767-metrics-certs\") pod \"network-metrics-daemon-bwp6p\" (UID: \"c7a433a3-b668-4fed-803f-eb31d9d4e767\") " pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:50:37.432618 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.432591 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b92gb\"" Jul 16 00:50:37.441595 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.441533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwp6p" Jul 16 00:50:37.569051 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.569020 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bwp6p"] Jul 16 00:50:37.571805 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:50:37.571767 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a433a3_b668_4fed_803f_eb31d9d4e767.slice/crio-100edf5cf8ab7b3a52f627872b5745259210a210b6ef5d2baa85e0fa527866c7 WatchSource:0}: Error finding container 100edf5cf8ab7b3a52f627872b5745259210a210b6ef5d2baa85e0fa527866c7: Status 404 returned error can't find the container with id 100edf5cf8ab7b3a52f627872b5745259210a210b6ef5d2baa85e0fa527866c7 Jul 16 00:50:37.573866 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.573845 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:50:37.668755 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:37.668717 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwp6p" event={"ID":"c7a433a3-b668-4fed-803f-eb31d9d4e767","Type":"ContainerStarted","Data":"100edf5cf8ab7b3a52f627872b5745259210a210b6ef5d2baa85e0fa527866c7"} Jul 16 00:50:38.674185 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:38.674153 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwp6p" event={"ID":"c7a433a3-b668-4fed-803f-eb31d9d4e767","Type":"ContainerStarted","Data":"f44f5f7418a8f8b3972ab43c315a49dc758f8083f48d5ca21ef2e0db16173c7c"} Jul 16 00:50:38.674521 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:38.674229 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwp6p" event={"ID":"c7a433a3-b668-4fed-803f-eb31d9d4e767","Type":"ContainerStarted","Data":"7447f94837cdcffcf287ff22fc1d41b6108bc1680ed2bb87f3d07f9fcaa2b1ce"} Jul 16 00:50:38.692920 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:38.692871 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bwp6p" podStartSLOduration=374.788953973 podStartE2EDuration="6m15.69285606s" totalImagesPullingTime="903.902087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:50:38.692246453 +0000 UTC m=+375.883691993" watchObservedRunningTime="2026-07-16 00:50:38.69285606 +0000 UTC m=+375.884301598" Jul 16 00:50:38.794762 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:38.794696 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:38.855570 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:38.855547 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:41.067683 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:41.067652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:41.124658 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:41.124625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:46.467000 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:46.466963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:46.567860 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:46.567828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:57.140123 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:57.140088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:57.201021 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:57.200989 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:57.619067 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:57.618993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:57.747350 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:57.747314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:57.813124 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:50:57.813097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:02.625722 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:02.625677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:22.190833 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:22.190801 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:26.418760 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:26.418722 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:26.517831 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:26.517790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:29.462412 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:29.462362 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:30.692224 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:30.692192 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:48.250902 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:48.250825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:49.068815 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:49.068786 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:50.284169 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.284128 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt"] Jul 16 00:51:50.284632 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.284517 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f10583-c058-484d-8317-8fdf04d2a96d" containerName="console" Jul 16 00:51:50.284632 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.284534 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f10583-c058-484d-8317-8fdf04d2a96d" containerName="console" Jul 16 00:51:50.284632 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.284621 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f10583-c058-484d-8317-8fdf04d2a96d" containerName="console" Jul 16 00:51:50.286374 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.286353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.290658 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.290639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:51:50.290750 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.290702 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 00:51:50.290826 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.290807 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fdwzq\"" Jul 16 00:51:50.316315 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.316285 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt"] Jul 16 00:51:50.429131 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.429097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmpk\" (UniqueName: \"kubernetes.io/projected/24993827-3481-4a5f-a640-38ce3601bc9f-kube-api-access-bsmpk\") pod \"cert-manager-operator-controller-manager-55c444bf86-5blpt\" (UID: \"24993827-3481-4a5f-a640-38ce3601bc9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.429298 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.429145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24993827-3481-4a5f-a640-38ce3601bc9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5blpt\" (UID: \"24993827-3481-4a5f-a640-38ce3601bc9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.529582 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.529546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24993827-3481-4a5f-a640-38ce3601bc9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5blpt\" (UID: \"24993827-3481-4a5f-a640-38ce3601bc9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.529779 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.529618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmpk\" (UniqueName: \"kubernetes.io/projected/24993827-3481-4a5f-a640-38ce3601bc9f-kube-api-access-bsmpk\") pod \"cert-manager-operator-controller-manager-55c444bf86-5blpt\" (UID: \"24993827-3481-4a5f-a640-38ce3601bc9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.529982 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.529959 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24993827-3481-4a5f-a640-38ce3601bc9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5blpt\" (UID: \"24993827-3481-4a5f-a640-38ce3601bc9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.538978 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.538922 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmpk\" (UniqueName: \"kubernetes.io/projected/24993827-3481-4a5f-a640-38ce3601bc9f-kube-api-access-bsmpk\") pod \"cert-manager-operator-controller-manager-55c444bf86-5blpt\" (UID: \"24993827-3481-4a5f-a640-38ce3601bc9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.595507 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.595482 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" Jul 16 00:51:50.736329 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.736300 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt"] Jul 16 00:51:50.739495 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:51:50.739460 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24993827_3481_4a5f_a640_38ce3601bc9f.slice/crio-e2a9dad396569bfc9a0bb1091e65eda6795194bf64dcf071d32a79778484189c WatchSource:0}: Error finding container e2a9dad396569bfc9a0bb1091e65eda6795194bf64dcf071d32a79778484189c: Status 404 returned error can't find the container with id e2a9dad396569bfc9a0bb1091e65eda6795194bf64dcf071d32a79778484189c Jul 16 00:51:50.951174 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:50.951140 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" event={"ID":"24993827-3481-4a5f-a640-38ce3601bc9f","Type":"ContainerStarted","Data":"e2a9dad396569bfc9a0bb1091e65eda6795194bf64dcf071d32a79778484189c"} Jul 16 00:51:51.874214 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:51.874182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:51.979449 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:51.979390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:53.966065 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:53.966035 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" event={"ID":"24993827-3481-4a5f-a640-38ce3601bc9f","Type":"ContainerStarted","Data":"bb5461d1dbc9911006f8b77b05a2750eb801786cdc297813e21d756d29960b5e"} Jul 16 00:51:53.993994 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:53.993946 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5blpt" podStartSLOduration=0.876387235 podStartE2EDuration="3.993931354s" totalImagesPullingTime="3.117544119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:51:53.9880066 +0000 UTC m=+451.179452140" watchObservedRunningTime="2026-07-16 00:51:53.993931354 +0000 UTC m=+451.185376894" Jul 16 00:51:54.387093 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.387065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:54.547978 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.547941 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:54.627309 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.627278 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b"] Jul 16 00:51:54.629650 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.629627 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.633648 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.633626 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:51:54.633749 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.633628 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:51:54.634272 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.634258 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztqwl\"" Jul 16 00:51:54.645704 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.645640 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b"] Jul 16 00:51:54.766298 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.766265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r7lh\" (UniqueName: \"kubernetes.io/projected/a18409c1-9801-4d50-99ad-338cdae61d0f-kube-api-access-5r7lh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.766481 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.766308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.766481 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.766424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.782582 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.782559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:54.866876 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.866840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.867020 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.866909 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.867020 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.866932 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r7lh\" (UniqueName: \"kubernetes.io/projected/a18409c1-9801-4d50-99ad-338cdae61d0f-kube-api-access-5r7lh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.867300 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.867277 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.867369 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.867286 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.884068 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.884040 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r7lh\" (UniqueName: \"kubernetes.io/projected/a18409c1-9801-4d50-99ad-338cdae61d0f-kube-api-access-5r7lh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:54.890044 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.890020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:54.939116 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:54.939058 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:51:55.074436 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:55.074410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b"] Jul 16 00:51:55.076200 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:51:55.076171 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18409c1_9801_4d50_99ad_338cdae61d0f.slice/crio-618d5437a2df20faf3fe7cbdb59ed34d20db4bb71e7718e627de400a245561cd WatchSource:0}: Error finding container 618d5437a2df20faf3fe7cbdb59ed34d20db4bb71e7718e627de400a245561cd: Status 404 returned error can't find the container with id 618d5437a2df20faf3fe7cbdb59ed34d20db4bb71e7718e627de400a245561cd Jul 16 00:51:55.975686 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:55.975654 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" event={"ID":"a18409c1-9801-4d50-99ad-338cdae61d0f","Type":"ContainerStarted","Data":"618d5437a2df20faf3fe7cbdb59ed34d20db4bb71e7718e627de400a245561cd"} Jul 16 00:51:57.168735 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:57.168698 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:57.372557 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:57.372510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:58.659466 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:58.659438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:58.760192 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:51:58.760154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:02.000788 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:02.000751 2573 generic.go:356] "Generic (PLEG): container finished" podID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerID="c7801079106b2485ea36979afceaae0e1fd029d92d4c375063b6ec6633eb03ae" exitCode=0 Jul 16 00:52:02.001190 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:02.000819 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" event={"ID":"a18409c1-9801-4d50-99ad-338cdae61d0f","Type":"ContainerDied","Data":"c7801079106b2485ea36979afceaae0e1fd029d92d4c375063b6ec6633eb03ae"} Jul 16 00:52:02.407993 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:02.407954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:04.768658 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:04.768627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:05.015686 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:05.015653 2573 generic.go:356] "Generic (PLEG): container finished" podID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerID="ba64776dbd8f10b92a18b74bb1c635448f8e903c7efad098cfd9656d45e64378" exitCode=0 Jul 16 00:52:05.015850 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:05.015728 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" event={"ID":"a18409c1-9801-4d50-99ad-338cdae61d0f","Type":"ContainerDied","Data":"ba64776dbd8f10b92a18b74bb1c635448f8e903c7efad098cfd9656d45e64378"} Jul 16 00:52:12.045625 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:12.045539 2573 generic.go:356] "Generic (PLEG): container finished" podID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerID="da10b99295f06dab51ec744550d086739009b1cb2fc4a14cf0a833e19b2a0dba" exitCode=0 Jul 16 00:52:12.045625 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:12.045586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" event={"ID":"a18409c1-9801-4d50-99ad-338cdae61d0f","Type":"ContainerDied","Data":"da10b99295f06dab51ec744550d086739009b1cb2fc4a14cf0a833e19b2a0dba"} Jul 16 00:52:13.171946 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.171922 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:52:13.319498 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.319423 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-util\") pod \"a18409c1-9801-4d50-99ad-338cdae61d0f\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " Jul 16 00:52:13.319498 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.319476 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r7lh\" (UniqueName: \"kubernetes.io/projected/a18409c1-9801-4d50-99ad-338cdae61d0f-kube-api-access-5r7lh\") pod \"a18409c1-9801-4d50-99ad-338cdae61d0f\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " Jul 16 00:52:13.319695 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.319503 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-bundle\") pod \"a18409c1-9801-4d50-99ad-338cdae61d0f\" (UID: \"a18409c1-9801-4d50-99ad-338cdae61d0f\") " Jul 16 00:52:13.319949 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.319924 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-bundle" (OuterVolumeSpecName: "bundle") pod "a18409c1-9801-4d50-99ad-338cdae61d0f" (UID: "a18409c1-9801-4d50-99ad-338cdae61d0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:52:13.321621 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.321603 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18409c1-9801-4d50-99ad-338cdae61d0f-kube-api-access-5r7lh" (OuterVolumeSpecName: "kube-api-access-5r7lh") pod "a18409c1-9801-4d50-99ad-338cdae61d0f" (UID: "a18409c1-9801-4d50-99ad-338cdae61d0f"). InnerVolumeSpecName "kube-api-access-5r7lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:52:13.325317 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.325292 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-util" (OuterVolumeSpecName: "util") pod "a18409c1-9801-4d50-99ad-338cdae61d0f" (UID: "a18409c1-9801-4d50-99ad-338cdae61d0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:52:13.420565 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.420540 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-util\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:52:13.420565 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.420562 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r7lh\" (UniqueName: \"kubernetes.io/projected/a18409c1-9801-4d50-99ad-338cdae61d0f-kube-api-access-5r7lh\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:52:13.420711 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:13.420572 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a18409c1-9801-4d50-99ad-338cdae61d0f-bundle\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 00:52:14.055107 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:14.055070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" event={"ID":"a18409c1-9801-4d50-99ad-338cdae61d0f","Type":"ContainerDied","Data":"618d5437a2df20faf3fe7cbdb59ed34d20db4bb71e7718e627de400a245561cd"} Jul 16 00:52:14.055269 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:14.055118 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flvh5b" Jul 16 00:52:14.055269 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:14.055124 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="618d5437a2df20faf3fe7cbdb59ed34d20db4bb71e7718e627de400a245561cd" Jul 16 00:52:16.230713 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:16.230680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:16.332907 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:16.332872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:21.658298 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:21.658260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:21.759837 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:21.759797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:22.081934 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:22.081847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:22.182948 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:22.182899 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:24.512556 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:24.512514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:36.741272 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.741218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:36.940728 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.940676 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:36.964855 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.964826 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8"] Jul 16 00:52:36.965099 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965087 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="pull" Jul 16 00:52:36.965148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965100 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="pull" Jul 16 00:52:36.965148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965118 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="extract" Jul 16 00:52:36.965148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965124 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="extract" Jul 16 00:52:36.965148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965132 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="util" Jul 16 00:52:36.965148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965137 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="util" Jul 16 00:52:36.965319 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.965184 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18409c1-9801-4d50-99ad-338cdae61d0f" containerName="extract" Jul 16 00:52:36.969880 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.969863 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:36.973599 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.973570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 00:52:36.974786 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.974763 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 00:52:36.974884 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.974810 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 00:52:36.974884 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.974819 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 00:52:36.974983 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.974896 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-grd8c\"" Jul 16 00:52:36.975062 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.975046 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:52:36.983501 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.983478 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8"] Jul 16 00:52:36.986329 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.986305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13dad44b-59a7-4499-958c-9a05b471ff89-manager-config\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:36.986444 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.986343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7vrp\" (UniqueName: \"kubernetes.io/projected/13dad44b-59a7-4499-958c-9a05b471ff89-kube-api-access-l7vrp\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:36.986444 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.986427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13dad44b-59a7-4499-958c-9a05b471ff89-metrics-cert\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:36.986524 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:36.986506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dad44b-59a7-4499-958c-9a05b471ff89-cert\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.052847 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.052746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:37.087462 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.087440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13dad44b-59a7-4499-958c-9a05b471ff89-manager-config\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.087551 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.087472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7vrp\" (UniqueName: \"kubernetes.io/projected/13dad44b-59a7-4499-958c-9a05b471ff89-kube-api-access-l7vrp\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.087551 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.087501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13dad44b-59a7-4499-958c-9a05b471ff89-metrics-cert\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.087617 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.087566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dad44b-59a7-4499-958c-9a05b471ff89-cert\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.088129 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.088097 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13dad44b-59a7-4499-958c-9a05b471ff89-manager-config\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.090167 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.090140 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13dad44b-59a7-4499-958c-9a05b471ff89-cert\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.090264 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.090148 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13dad44b-59a7-4499-958c-9a05b471ff89-metrics-cert\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.097841 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.097818 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7vrp\" (UniqueName: \"kubernetes.io/projected/13dad44b-59a7-4499-958c-9a05b471ff89-kube-api-access-l7vrp\") pod \"lws-controller-manager-57c869f4fd-ddhj8\" (UID: \"13dad44b-59a7-4499-958c-9a05b471ff89\") " pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.279046 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.279011 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:37.424965 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.424940 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8"] Jul 16 00:52:37.427360 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:52:37.427334 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13dad44b_59a7_4499_958c_9a05b471ff89.slice/crio-8973d4f9d563336b12c180e75d24741256b06ea9611ff39f5dc1940c7b2083a2 WatchSource:0}: Error finding container 8973d4f9d563336b12c180e75d24741256b06ea9611ff39f5dc1940c7b2083a2: Status 404 returned error can't find the container with id 8973d4f9d563336b12c180e75d24741256b06ea9611ff39f5dc1940c7b2083a2 Jul 16 00:52:37.433296 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.433273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:37.831553 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.831522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:37.931301 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:37.931270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.052183 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.052150 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx"] Jul 16 00:52:38.055534 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.055466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.066442 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.066419 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 00:52:38.066589 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.066470 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 00:52:38.066589 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.066489 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 00:52:38.066694 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.066646 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 00:52:38.066881 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.066865 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wdc6\"" Jul 16 00:52:38.084615 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.084554 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx"] Jul 16 00:52:38.098153 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.098123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88jl\" (UniqueName: \"kubernetes.io/projected/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-kube-api-access-z88jl\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.098316 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.098181 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.098316 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.098230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.098316 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.098266 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.098316 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.098289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.164118 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.164086 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" event={"ID":"13dad44b-59a7-4499-958c-9a05b471ff89","Type":"ContainerStarted","Data":"8973d4f9d563336b12c180e75d24741256b06ea9611ff39f5dc1940c7b2083a2"} Jul 16 00:52:38.198903 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.198861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88jl\" (UniqueName: \"kubernetes.io/projected/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-kube-api-access-z88jl\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.199087 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.198919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.199087 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.198969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.199087 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.199003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.199087 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.199027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.199803 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.199745 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-manifests\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.202926 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.202877 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-tmp\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.202926 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.202879 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-webhook-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.203094 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.202979 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.211922 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.211809 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88jl\" (UniqueName: \"kubernetes.io/projected/6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a-kube-api-access-z88jl\") pod \"opendatahub-operator-controller-manager-795c7898c9-jrkzx\" (UID: \"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a\") " pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.248509 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.248468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.339898 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.339818 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.365641 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.365610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:38.441812 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.441765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.505029 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.505001 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx"] Jul 16 00:52:38.507353 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:52:38.507320 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6331d7f9_05f0_4abc_9ea6_6eb6b8fad31a.slice/crio-b4d16ee6cd2f7c15a8515e9b5c6f53630388f04e0e481e6969088d0a40dbc21a WatchSource:0}: Error finding container b4d16ee6cd2f7c15a8515e9b5c6f53630388f04e0e481e6969088d0a40dbc21a: Status 404 returned error can't find the container with id b4d16ee6cd2f7c15a8515e9b5c6f53630388f04e0e481e6969088d0a40dbc21a Jul 16 00:52:38.539098 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.538956 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.618053 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.617979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.721054 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.721017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:38.817683 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:38.817651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:39.171505 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:39.171468 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" event={"ID":"13dad44b-59a7-4499-958c-9a05b471ff89","Type":"ContainerStarted","Data":"e58bfeb47634e5b06d22a001ccb21e5e4a287e2ce3177fe88022d6fbed5b4315"} Jul 16 00:52:39.171976 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:39.171575 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:39.173690 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:39.173653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" event={"ID":"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a","Type":"ContainerStarted","Data":"b4d16ee6cd2f7c15a8515e9b5c6f53630388f04e0e481e6969088d0a40dbc21a"} Jul 16 00:52:39.189503 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:39.189451 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" podStartSLOduration=1.615360719 podStartE2EDuration="3.189432476s" totalImagesPullingTime="1.574071757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:39.188549135 +0000 UTC m=+496.379994698" watchObservedRunningTime="2026-07-16 00:52:39.189432476 +0000 UTC m=+496.380878016" Jul 16 00:52:42.190755 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:42.190720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" event={"ID":"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a","Type":"ContainerStarted","Data":"5de66ebd84281c7827bf53dd4241e18e22e68870fb1b4f77d801026ba332f57f"} Jul 16 00:52:43.195584 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:43.195547 2573 generic.go:356] "Generic (PLEG): container finished" podID="6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a" containerID="5de66ebd84281c7827bf53dd4241e18e22e68870fb1b4f77d801026ba332f57f" exitCode=0 Jul 16 00:52:43.196008 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:43.195619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" event={"ID":"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a","Type":"ContainerDied","Data":"5de66ebd84281c7827bf53dd4241e18e22e68870fb1b4f77d801026ba332f57f"} Jul 16 00:52:44.201301 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:44.201261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" event={"ID":"6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a","Type":"ContainerStarted","Data":"fb72f84a334eecb6cc8f42e847e148221d86b7c18840df38baacaf6435192d5d"} Jul 16 00:52:44.201708 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:44.201419 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:44.224004 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:44.223899 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" podStartSLOduration=1.840908433 podStartE2EDuration="6.223881417s" totalImagesPullingTime="3.2876573s" totalInitContainerRuntime="1.095315684s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:52:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:52:44.222425139 +0000 UTC m=+501.413870694" watchObservedRunningTime="2026-07-16 00:52:44.223881417 +0000 UTC m=+501.415326957" Jul 16 00:52:49.731552 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:49.731513 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:49.830803 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:49.830770 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:50.181907 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:50.181879 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57c869f4fd-ddhj8" Jul 16 00:52:55.208249 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:55.208218 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-795c7898c9-jrkzx" Jul 16 00:52:57.480948 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:57.480916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:57.594938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:57.594907 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:58.097148 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:58.097114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:58.251163 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:58.251127 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:58.378756 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:58.378668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:58.446293 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:58.446259 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:58.547639 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:58.547606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:58.772124 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:58.772033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:59.176138 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:59.176093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:59.561937 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:59.561842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:59.775040 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:59.775001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:59.861346 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:52:59.861205 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:00.896117 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:00.896085 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:05.603323 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.603284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:05.697763 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.697730 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:05.701884 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.701858 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j"] Jul 16 00:53:05.708897 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.708876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.712223 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.712204 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-576rm\"" Jul 16 00:53:05.712339 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.712241 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 00:53:05.712654 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.712641 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 00:53:05.712696 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.712643 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 00:53:05.712948 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.712922 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 00:53:05.713007 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.712951 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 00:53:05.713141 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.713129 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 00:53:05.723457 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.723437 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j"] Jul 16 00:53:05.839419 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f390fe65-e063-42d6-94a5-437f46dfe8d3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.839610 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.839610 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.839610 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839582 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.839760 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.839760 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f4b7\" (UniqueName: \"kubernetes.io/projected/f390fe65-e063-42d6-94a5-437f46dfe8d3-kube-api-access-2f4b7\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.839760 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.839688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940452 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940626 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940626 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940626 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f4b7\" (UniqueName: \"kubernetes.io/projected/f390fe65-e063-42d6-94a5-437f46dfe8d3-kube-api-access-2f4b7\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940626 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940626 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f390fe65-e063-42d6-94a5-437f46dfe8d3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.940900 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.940668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.941644 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.941619 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.943597 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.943527 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.943597 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.943550 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.943751 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.943649 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.943990 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.943968 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f390fe65-e063-42d6-94a5-437f46dfe8d3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.955723 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.955658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:05.957489 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.957470 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f4b7\" (UniqueName: \"kubernetes.io/projected/f390fe65-e063-42d6-94a5-437f46dfe8d3-kube-api-access-2f4b7\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:05.957787 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:05.957771 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f390fe65-e063-42d6-94a5-437f46dfe8d3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8nk6j\" (UID: \"f390fe65-e063-42d6-94a5-437f46dfe8d3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:06.018797 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:06.018723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:06.128704 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:06.128670 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:06.161267 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:06.161247 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j"] Jul 16 00:53:06.163447 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:53:06.163418 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf390fe65_e063_42d6_94a5_437f46dfe8d3.slice/crio-80c6ce53178643be186285646b8d91489a14cdd5651550ffc46341c37335c35f WatchSource:0}: Error finding container 80c6ce53178643be186285646b8d91489a14cdd5651550ffc46341c37335c35f: Status 404 returned error can't find the container with id 80c6ce53178643be186285646b8d91489a14cdd5651550ffc46341c37335c35f Jul 16 00:53:06.230225 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:06.230163 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:06.304779 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:06.304735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" event={"ID":"f390fe65-e063-42d6-94a5-437f46dfe8d3","Type":"ContainerStarted","Data":"80c6ce53178643be186285646b8d91489a14cdd5651550ffc46341c37335c35f"} Jul 16 00:53:08.370873 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:08.370820 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:53:08.371210 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:08.370932 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:53:08.669138 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:08.669070 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:08.790291 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:08.790262 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:08.977334 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:08.977244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:09.061374 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:09.061342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:09.323966 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:09.323871 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" event={"ID":"f390fe65-e063-42d6-94a5-437f46dfe8d3","Type":"ContainerStarted","Data":"5f55cbc36fac09437a834080f8c950ef86d23e7515bd1cab561eb9bd173970bd"} Jul 16 00:53:09.324135 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:09.324035 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:09.325725 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:09.325698 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-8nk6j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 00:53:09.325835 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:09.325759 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" podUID="f390fe65-e063-42d6-94a5-437f46dfe8d3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:53:09.358307 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:09.358250 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" podStartSLOduration=2.153050232 podStartE2EDuration="4.358230755s" totalImagesPullingTime="2.205180523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:53:09.357827609 +0000 UTC m=+526.549273158" watchObservedRunningTime="2026-07-16 00:53:09.358230755 +0000 UTC m=+526.549676295" Jul 16 00:53:10.039661 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:10.039624 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:10.129938 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:10.129907 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:10.199645 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:10.199614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:10.329324 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:10.329244 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8nk6j" Jul 16 00:53:28.683111 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:28.683034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:58.937238 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:53:58.937205 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:00.317153 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:00.317126 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:24.871612 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:24.871585 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:54:24.875211 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:24.875190 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:54:28.294520 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:28.294490 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:31.273059 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:31.273020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:31.740925 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:31.740892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:33.285330 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:33.285295 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:33.695575 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:33.695545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:34.310103 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:34.310071 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:34.413518 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:34.413484 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:34.756969 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:34.756941 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:34.857462 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:34.857434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:36.314953 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:36.314919 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:36.410688 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:36.410655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:36.598384 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:36.598298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:36.699491 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:36.699463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:38.503878 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:38.503828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:40.339569 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:40.339538 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:42.306983 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:42.306954 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:42.393652 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:42.393620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:42.491661 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:42.491616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:45.294741 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:45.294664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:45.397026 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:45.396991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:45.468709 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:45.468682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:53.739983 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:53.739945 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:53.842974 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:53.842944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:54.315077 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:54.315040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:54.413183 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:54.413154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:58.100085 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:58.100056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:58.198126 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:54:58.198082 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:02.099112 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:02.099081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:02.203893 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:02.203858 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:02.437463 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:02.437432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:02.538901 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:02.538875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:06.704541 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:06.704506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:06.806900 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:06.806854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:16.320067 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:16.320034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:16.414887 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:16.414853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:18.777593 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:18.777557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:18.877590 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:18.877558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:21.625627 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:21.625591 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:21.916175 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:21.916145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:23.365617 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.365584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:23.477377 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.477337 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:23.579486 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.579453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:23.790010 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.789981 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:55:23.793120 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.793104 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:23.795515 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.795488 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 16 00:55:23.795668 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.795566 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gnl4z\"" Jul 16 00:55:23.795731 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.795680 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:55:23.796282 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.796266 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:55:23.802976 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.802955 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:55:23.826220 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.826192 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:55:23.869551 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.869522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65fc0c1c-fb9d-4ae5-84a4-867375fba024-config-file\") pod \"limitador-limitador-54d6d988d5-bzn5c\" (UID: \"65fc0c1c-fb9d-4ae5-84a4-867375fba024\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:23.869706 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.869566 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48z24\" (UniqueName: \"kubernetes.io/projected/65fc0c1c-fb9d-4ae5-84a4-867375fba024-kube-api-access-48z24\") pod \"limitador-limitador-54d6d988d5-bzn5c\" (UID: \"65fc0c1c-fb9d-4ae5-84a4-867375fba024\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:23.970164 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.970132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48z24\" (UniqueName: \"kubernetes.io/projected/65fc0c1c-fb9d-4ae5-84a4-867375fba024-kube-api-access-48z24\") pod \"limitador-limitador-54d6d988d5-bzn5c\" (UID: \"65fc0c1c-fb9d-4ae5-84a4-867375fba024\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:23.970313 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.970213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65fc0c1c-fb9d-4ae5-84a4-867375fba024-config-file\") pod \"limitador-limitador-54d6d988d5-bzn5c\" (UID: \"65fc0c1c-fb9d-4ae5-84a4-867375fba024\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:23.970850 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.970832 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65fc0c1c-fb9d-4ae5-84a4-867375fba024-config-file\") pod \"limitador-limitador-54d6d988d5-bzn5c\" (UID: \"65fc0c1c-fb9d-4ae5-84a4-867375fba024\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:23.979740 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:23.979719 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48z24\" (UniqueName: \"kubernetes.io/projected/65fc0c1c-fb9d-4ae5-84a4-867375fba024-kube-api-access-48z24\") pod \"limitador-limitador-54d6d988d5-bzn5c\" (UID: \"65fc0c1c-fb9d-4ae5-84a4-867375fba024\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:24.103517 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:24.103437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:24.233015 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:24.232990 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:55:24.235408 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:55:24.235369 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fc0c1c_fb9d_4ae5_84a4_867375fba024.slice/crio-fb8dde2edaa4bb2e144c762bea5311312a3a3259d24fb0a138ab7f3485400159 WatchSource:0}: Error finding container fb8dde2edaa4bb2e144c762bea5311312a3a3259d24fb0a138ab7f3485400159: Status 404 returned error can't find the container with id fb8dde2edaa4bb2e144c762bea5311312a3a3259d24fb0a138ab7f3485400159 Jul 16 00:55:24.235850 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:24.235831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:24.337302 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:24.337269 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:24.891003 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:24.890970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" event={"ID":"65fc0c1c-fb9d-4ae5-84a4-867375fba024","Type":"ContainerStarted","Data":"fb8dde2edaa4bb2e144c762bea5311312a3a3259d24fb0a138ab7f3485400159"} Jul 16 00:55:26.902564 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:26.902467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" event={"ID":"65fc0c1c-fb9d-4ae5-84a4-867375fba024","Type":"ContainerStarted","Data":"4117bc223df6bfc16e0a7156ef3adb40c31a9a144376019599c8948e165525c9"} Jul 16 00:55:26.902908 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:26.902573 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:26.920520 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:26.920470 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" podStartSLOduration=1.522853146 podStartE2EDuration="3.920455346s" totalImagesPullingTime="2.3976022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:55:26.919972376 +0000 UTC m=+664.111417919" watchObservedRunningTime="2026-07-16 00:55:26.920455346 +0000 UTC m=+664.111900885" Jul 16 00:55:27.729211 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:27.729174 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:27.797381 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:27.797341 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:36.734534 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:36.734497 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:36.830692 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:36.830657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:37.908034 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:37.907999 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bzn5c" Jul 16 00:55:39.170008 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:39.169977 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:39.270643 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:39.270614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:39.483909 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:39.483827 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:39.583278 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:39.583246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:39.970002 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:39.969971 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:43.935863 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:43.935833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:44.035947 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:44.035903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:52.035494 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:52.035455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:52.261443 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:52.261411 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:59.275381 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:59.275331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:59.341891 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:59.341859 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:59.397205 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:55:59.397174 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:00.005525 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:00.005491 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:02.548410 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:02.548376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:02.645546 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:02.645513 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:31.227991 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:31.227909 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:31.327734 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:31.327700 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:31.728837 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:31.728804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:31.831656 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:31.831627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:32.224268 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:32.224237 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:32.318696 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:32.318665 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:32.395505 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:32.395472 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:56:41.979359 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:41.979320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:42.082912 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:42.082878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:50.805027 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:50.804980 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:51.205595 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:56:51.205562 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:57:12.229311 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:12.229276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:57:13.088432 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:13.088382 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:57:24.980721 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.980683 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d"] Jul 16 00:57:24.983898 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.983880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:24.986250 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.986228 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 00:57:24.987037 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.987017 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 00:57:24.987123 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.987039 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 00:57:24.987181 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.987129 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n7pbs\"" Jul 16 00:57:24.992575 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:24.992553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d"] Jul 16 00:57:25.014317 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.014291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:57:25.059318 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.059291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.059479 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.059329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwwc\" (UniqueName: \"kubernetes.io/projected/4c166970-0705-4e67-8ab6-6cdcda0c2003-kube-api-access-9bwwc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.059479 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.059356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.059479 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.059435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.059479 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.059472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.059617 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.059515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c166970-0705-4e67-8ab6-6cdcda0c2003-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.160943 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.160908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.160943 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.160948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161129 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.160979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c166970-0705-4e67-8ab6-6cdcda0c2003-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161129 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.161016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161129 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.161041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwwc\" (UniqueName: \"kubernetes.io/projected/4c166970-0705-4e67-8ab6-6cdcda0c2003-kube-api-access-9bwwc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161129 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.161070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161373 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.161349 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161447 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.161429 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.161510 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.161500 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.163503 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.163459 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c166970-0705-4e67-8ab6-6cdcda0c2003-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.163631 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.163611 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c166970-0705-4e67-8ab6-6cdcda0c2003-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.168578 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.168560 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwwc\" (UniqueName: \"kubernetes.io/projected/4c166970-0705-4e67-8ab6-6cdcda0c2003-kube-api-access-9bwwc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvf7d\" (UID: \"4c166970-0705-4e67-8ab6-6cdcda0c2003\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.294950 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.294876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:25.424700 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.424673 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d"] Jul 16 00:57:25.426425 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:57:25.426385 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c166970_0705_4e67_8ab6_6cdcda0c2003.slice/crio-721fcb22c9245e6aa88bca226188fe5ffdde8329c218f9378679e3349903fe63 WatchSource:0}: Error finding container 721fcb22c9245e6aa88bca226188fe5ffdde8329c218f9378679e3349903fe63: Status 404 returned error can't find the container with id 721fcb22c9245e6aa88bca226188fe5ffdde8329c218f9378679e3349903fe63 Jul 16 00:57:25.427788 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:25.427767 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:57:26.188613 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:26.188581 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:57:26.396321 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:26.396281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" event={"ID":"4c166970-0705-4e67-8ab6-6cdcda0c2003","Type":"ContainerStarted","Data":"721fcb22c9245e6aa88bca226188fe5ffdde8329c218f9378679e3349903fe63"} Jul 16 00:57:27.402451 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:27.402413 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" event={"ID":"4c166970-0705-4e67-8ab6-6cdcda0c2003","Type":"ContainerStarted","Data":"3236ed7216262163400cc9ac370965e92a4d6241a6255516d77a17ecd4cea651"} Jul 16 00:57:27.421074 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:27.421020 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" podStartSLOduration=2.415577046 podStartE2EDuration="3.421004809s" totalImagesPullingTime="1.005427763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:57:27.419508616 +0000 UTC m=+784.610954156" watchObservedRunningTime="2026-07-16 00:57:27.421004809 +0000 UTC m=+784.612450348" Jul 16 00:57:28.355388 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:28.355354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:57:30.525698 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:30.525667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:57:32.188863 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:32.188832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:57:35.294991 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:35.294959 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:35.295453 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:35.295051 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:35.307730 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:35.307705 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:35.449002 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:35.448974 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvf7d" Jul 16 00:57:43.086965 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.086931 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn"] Jul 16 00:57:43.091885 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.091862 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.094536 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.094515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 16 00:57:43.099209 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.099067 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn"] Jul 16 00:57:43.109750 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.109724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.109846 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.109755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.109846 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.109773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.109846 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.109809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmz7j\" (UniqueName: \"kubernetes.io/projected/86427836-d4df-4579-9f89-892c74eb633e-kube-api-access-kmz7j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.109962 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.109862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.109962 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.109876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86427836-d4df-4579-9f89-892c74eb633e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.117326 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.117302 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:57:43.210402 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210376 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210538 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210538 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210439 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210538 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210479 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmz7j\" (UniqueName: \"kubernetes.io/projected/86427836-d4df-4579-9f89-892c74eb633e-kube-api-access-kmz7j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210538 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210758 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86427836-d4df-4579-9f89-892c74eb633e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210835 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210811 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.210926 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210895 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.211035 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.210924 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.212728 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.212706 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86427836-d4df-4579-9f89-892c74eb633e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.212926 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.212909 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86427836-d4df-4579-9f89-892c74eb633e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.218296 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.218274 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmz7j\" (UniqueName: \"kubernetes.io/projected/86427836-d4df-4579-9f89-892c74eb633e-kube-api-access-kmz7j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zl9dn\" (UID: \"86427836-d4df-4579-9f89-892c74eb633e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.405630 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.405601 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:43.536960 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:43.536821 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn"] Jul 16 00:57:43.539323 ip-10-0-138-126 kubenswrapper[2573]: W0716 00:57:43.539297 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86427836_d4df_4579_9f89_892c74eb633e.slice/crio-cfbe8b5b315d08d13fa6c5c1d90fbae5ce6d37a626fdc0e385180bb7cef4e9b9 WatchSource:0}: Error finding container cfbe8b5b315d08d13fa6c5c1d90fbae5ce6d37a626fdc0e385180bb7cef4e9b9: Status 404 returned error can't find the container with id cfbe8b5b315d08d13fa6c5c1d90fbae5ce6d37a626fdc0e385180bb7cef4e9b9 Jul 16 00:57:44.474716 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:44.474685 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" event={"ID":"86427836-d4df-4579-9f89-892c74eb633e","Type":"ContainerStarted","Data":"65908d80d41b73673f5c51a2b4713c29a48c345536bee831aee0f46930eab1a0"} Jul 16 00:57:44.475064 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:44.474738 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" event={"ID":"86427836-d4df-4579-9f89-892c74eb633e","Type":"ContainerStarted","Data":"cfbe8b5b315d08d13fa6c5c1d90fbae5ce6d37a626fdc0e385180bb7cef4e9b9"} Jul 16 00:57:44.494617 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:44.494554 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" podStartSLOduration=1.3202192799999999 podStartE2EDuration="1.494533865s" totalImagesPullingTime="174.314585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:57:44.493585258 +0000 UTC m=+801.685030799" watchObservedRunningTime="2026-07-16 00:57:44.494533865 +0000 UTC m=+801.685979404" Jul 16 00:57:44.988969 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:44.988890 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:57:53.406086 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:53.406051 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:53.406484 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:53.406121 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:53.418758 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:53.418735 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:53.521752 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:53.521725 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zl9dn" Jul 16 00:57:58.415470 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:58.415440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:57:58.471700 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:57:58.471671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:58:00.539935 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:58:00.539893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:58:03.112716 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:58:03.112679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:58:05.201362 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:58:05.201333 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:58:59.581841 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:58:59.581792 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:58:59.704877 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:58:59.704844 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:59:00.748976 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:00.748946 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:59:01.941887 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:01.941855 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:59:24.702174 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:24.702138 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 00:59:24.904072 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:24.904043 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:59:24.909365 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:24.909345 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 00:59:28.397782 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:28.397745 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:59:38.189981 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:38.189945 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:59:48.493650 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:48.493616 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 00:59:58.986682 ip-10-0-138-126 kubenswrapper[2573]: I0716 00:59:58.986648 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:00:00.151068 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:00.151028 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst"] Jul 16 01:00:00.154515 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:00.154490 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" Jul 16 01:00:00.157036 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:00.157015 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7sk4l\"" Jul 16 01:00:00.163303 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:00.163276 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst"] Jul 16 01:00:00.165250 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:00.165233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" Jul 16 01:00:00.295022 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:00.294999 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst"] Jul 16 01:00:00.297167 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:00:00.297138 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab42efd_d4b1_4dc7_bb71_cb8ddf1cde6b.slice/crio-9f0f170ebebfb75a04e0d2e9ba464603cbd3b7f21e7355aba953a107a979acbb WatchSource:0}: Error finding container 9f0f170ebebfb75a04e0d2e9ba464603cbd3b7f21e7355aba953a107a979acbb: Status 404 returned error can't find the container with id 9f0f170ebebfb75a04e0d2e9ba464603cbd3b7f21e7355aba953a107a979acbb Jul 16 01:00:01.062645 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:01.062610 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" event={"ID":"cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b","Type":"ContainerStarted","Data":"9f0f170ebebfb75a04e0d2e9ba464603cbd3b7f21e7355aba953a107a979acbb"} Jul 16 01:00:05.082605 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:05.082568 2573 generic.go:356] "Generic (PLEG): container finished" podID="cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b" containerID="67c8ffa739ad17a2265a425e987316dbebdb7f7714ccdb046f0bb552b53cb0f0" exitCode=0 Jul 16 01:00:05.083031 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:05.082659 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" event={"ID":"cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b","Type":"ContainerDied","Data":"67c8ffa739ad17a2265a425e987316dbebdb7f7714ccdb046f0bb552b53cb0f0"} Jul 16 01:00:06.212100 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:06.212076 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" Jul 16 01:00:07.092322 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:07.092295 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" Jul 16 01:00:07.092511 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:07.092328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736060-mlqst" event={"ID":"cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b","Type":"ContainerDied","Data":"9f0f170ebebfb75a04e0d2e9ba464603cbd3b7f21e7355aba953a107a979acbb"} Jul 16 01:00:07.092511 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:07.092377 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f0f170ebebfb75a04e0d2e9ba464603cbd3b7f21e7355aba953a107a979acbb" Jul 16 01:00:08.391546 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:08.391508 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:00:11.157521 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:11.157479 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:12.672482 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:12.672449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:35.102592 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:35.102557 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:00:48.394571 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:48.394487 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:00:51.571065 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:51.571027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:51.671060 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:51.671009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:51.808996 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:51.808966 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:57.671333 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:57.671298 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:57.773884 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:57.773850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:57.871385 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:57.871353 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:00:58.027052 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:00:58.026975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:01:03.910965 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:03.910931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:01:05.736862 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:05.736830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:01:07.177767 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:07.177729 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:01:14.158512 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:14.158476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:01:14.216812 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:14.216775 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:01:20.218023 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:20.217977 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:01:33.791857 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:33.791817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:01:44.394223 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:44.394187 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:01:50.288913 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:01:50.288875 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:02:00.700003 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:02:00.699976 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:02:10.292760 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:02:10.292725 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:02:21.586231 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:02:21.586154 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:02:31.247786 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:02:31.247751 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:02:56.897826 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:02:56.897792 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:03:06.195632 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:03:06.195597 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:03:30.702250 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:03:30.702213 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:03:41.295017 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:03:41.294977 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:03:57.094640 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:03:57.094557 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:04:06.204156 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:04:06.204122 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:04:15.898902 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:04:15.898868 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:04:24.930786 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:04:24.930684 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:04:24.936343 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:04:24.936325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:04:25.189412 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:04:25.189315 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:04:35.794228 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:04:35.794193 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:05:05.968245 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:05:05.968198 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:05:23.939933 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:05:23.939896 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:06:23.491786 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:06:23.491753 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:06:35.199513 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:06:35.199471 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:06:47.292648 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:06:47.292567 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:01.098844 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:01.098814 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:10.790898 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:10.790862 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:19.800108 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:19.800073 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:29.909478 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:29.909436 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:39.932334 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:39.932296 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:50.990330 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:50.990292 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:07:57.442453 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:57.442414 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:07:57.528760 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:57.528730 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:07:59.899079 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:07:59.899040 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:08:11.196551 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:08:11.196516 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:08:35.492812 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:08:35.492732 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:08:42.729093 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:08:42.729056 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:08:53.094820 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:08:53.094782 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:09:03.294865 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:03.294825 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:09:11.996625 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:11.996588 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:09:13.440312 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:13.440280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:09:24.098501 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:24.098463 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:09:24.957082 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:24.956972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:09:24.963544 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:24.963523 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:09:33.402619 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:33.402578 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:09:42.586142 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:42.586111 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:09:51.486763 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:09:51.486679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:10:02.593683 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:02.593652 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:10:08.515490 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:08.515452 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:10:12.089777 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:12.089737 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:10:20.394493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:20.394461 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:10:29.500406 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:29.500370 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:10:39.089434 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:39.089383 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:10:48.597242 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:10:48.597206 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:11:01.188724 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:01.188691 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:11:12.201359 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:12.201324 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:11:12.354845 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:12.354810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:11:23.397440 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:23.397347 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:11:35.200997 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:35.200950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:11:48.699370 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:48.699336 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:11:58.083520 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:11:58.083484 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:12:00.578174 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:00.578134 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:08.076741 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:08.076705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:09.893987 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:09.893954 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:12:16.304441 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:16.304390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:21.189040 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:21.189002 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:12:21.417036 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:21.416996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:24.433061 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:24.433020 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:24.526795 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:24.526759 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:24.927561 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:24.927529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:30.392872 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:30.392834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:12:30.842912 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:30.842824 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:30.945907 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:30.945873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:31.074895 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:31.074865 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:31.178180 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:31.178142 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:31.273215 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:31.273185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:31.352604 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:31.352567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:31.537439 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:31.537337 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:31.953884 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:31.953854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:32.055559 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:32.055528 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:35.131302 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:35.131267 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:37.436844 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:37.436811 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:37.539226 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:37.539197 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:39.054642 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:39.054615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:43.700036 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:43.700000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:43.793338 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:43.793301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:43.979405 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:43.979312 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.084015 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.083984 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.177204 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.177176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.276049 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.275969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.384693 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.384659 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.496897 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.496866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.712208 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.712180 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:44.995915 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:44.995795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:45.094870 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:45.094842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:47.443938 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:47.443903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:47.608466 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:47.608431 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:12:50.043415 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:50.043355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:50.139131 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:50.139097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:53.286676 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:53.286645 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.248929 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.248885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.317241 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.317212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.470283 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.470248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.587773 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.587702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.671386 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.671357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.751363 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.751331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:56.881421 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:56.881380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:57.389624 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:57.389591 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:12:57.492309 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:12:57.492278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:00.079366 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:00.079329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:00.197940 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:00.197903 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:13:02.158648 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:02.158606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:02.278292 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:02.278254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:04.035509 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:04.035473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:08.559278 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:08.559244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:08.660183 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:08.660153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:09.038085 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:09.038053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:09.137238 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:09.137209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:09.237785 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:09.237755 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:10.583319 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:10.583286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:13.089933 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:13.089897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:13:17.498903 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:17.498874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:17.604181 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:17.604153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:17.707082 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:17.707054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:17.799842 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:17.799761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:18.204624 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:18.204594 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:44.172605 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:44.172572 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:50.130835 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:50.130797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:50.318978 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:50.318923 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:13:50.430691 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:13:50.430613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:06.234247 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:06.234211 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:12.129983 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:12.129947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:12.196679 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:12.196653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:12.280970 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:12.280940 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:12.380338 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:12.380264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:22.846602 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:22.846548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:23.633263 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:23.633230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:24.982720 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:24.982618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:14:24.989702 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:24.989685 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:14:29.785746 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:29.785711 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:29.891571 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:29.891531 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:29.985839 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:29.985802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:30.087491 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:30.087417 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:30.890844 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:30.890802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:30.990051 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:30.990017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:31.087778 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:31.087744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:32.292442 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:32.292403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:14:32.644386 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:32.644335 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:38.864747 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:38.864704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:38.965482 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:38.965452 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:39.538387 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:39.538356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:40.091054 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:40.091020 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:14:45.484042 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:45.484009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:45.556705 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:45.556679 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:45.725113 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:45.725086 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:46.061330 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:46.061295 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:46.279154 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:46.279121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:47.779066 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:47.778997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:47.860446 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:47.860369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:48.109390 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:48.109307 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:48.592684 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:48.592651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:48.693839 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:48.693805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:48.997738 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:48.997710 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:49.295348 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:49.295272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:14:53.276247 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:53.276212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:53.929487 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:53.929437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:54.028619 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:54.028584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:14:54.399007 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:14:54.398968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:00.131260 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.131228 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq"] Jul 16 01:15:00.131677 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.131590 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b" containerName="cleanup" Jul 16 01:15:00.131677 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.131601 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b" containerName="cleanup" Jul 16 01:15:00.131677 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.131663 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b" containerName="cleanup" Jul 16 01:15:00.134899 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.134876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" Jul 16 01:15:00.135141 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.135110 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd"] Jul 16 01:15:00.137916 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.137890 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7sk4l\"" Jul 16 01:15:00.138198 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.138177 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2"] Jul 16 01:15:00.138446 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.138424 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" Jul 16 01:15:00.141749 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.141730 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9"] Jul 16 01:15:00.141880 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.141862 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" Jul 16 01:15:00.144578 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.144556 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d"] Jul 16 01:15:00.144692 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.144672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" Jul 16 01:15:00.147652 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.147634 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" Jul 16 01:15:00.147795 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.147773 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq"] Jul 16 01:15:00.147878 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.147869 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" Jul 16 01:15:00.149596 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.149581 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd"] Jul 16 01:15:00.151210 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.151166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2"] Jul 16 01:15:00.153281 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.153266 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9"] Jul 16 01:15:00.155745 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.155560 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d"] Jul 16 01:15:00.175522 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.175496 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" Jul 16 01:15:00.183437 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.183415 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" Jul 16 01:15:00.220143 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.219994 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" Jul 16 01:15:00.231815 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.231781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" Jul 16 01:15:00.335982 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.335510 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq"] Jul 16 01:15:00.339508 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:15:00.339467 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503d96ab_793c_44bc_ab99_0e1735682cfb.slice/crio-8b6fddb34330db5ebd0ecae495aeff07324ee193de71a4ba697002050f0b476d WatchSource:0}: Error finding container 8b6fddb34330db5ebd0ecae495aeff07324ee193de71a4ba697002050f0b476d: Status 404 returned error can't find the container with id 8b6fddb34330db5ebd0ecae495aeff07324ee193de71a4ba697002050f0b476d Jul 16 01:15:00.404914 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.404843 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2"] Jul 16 01:15:00.408915 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:15:00.408882 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643dab73_e2b5_443b_bc8b_fe88ffc66c39.slice/crio-6a5ed6ae3282e396eb121f756b701901e8de43e394bd4034e0575a7f440b3c51 WatchSource:0}: Error finding container 6a5ed6ae3282e396eb121f756b701901e8de43e394bd4034e0575a7f440b3c51: Status 404 returned error can't find the container with id 6a5ed6ae3282e396eb121f756b701901e8de43e394bd4034e0575a7f440b3c51 Jul 16 01:15:00.431283 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.431128 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9"] Jul 16 01:15:00.433871 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:15:00.433840 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6832a414_4ccf_499e_9151_ab0384fe0973.slice/crio-7cb6ff702e88fa34866c18c7edc3c9aeea836c4730bc0f1e980175a25058fb0a WatchSource:0}: Error finding container 7cb6ff702e88fa34866c18c7edc3c9aeea836c4730bc0f1e980175a25058fb0a: Status 404 returned error can't find the container with id 7cb6ff702e88fa34866c18c7edc3c9aeea836c4730bc0f1e980175a25058fb0a Jul 16 01:15:00.451275 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.451251 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d"] Jul 16 01:15:00.451641 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:15:00.451606 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb2cb5e_bde7_4304_a0c2_65b84c33e375.slice/crio-f2a8be82a048a060f9e6258e21da6342373878a12371776de547cf69424b61ae WatchSource:0}: Error finding container f2a8be82a048a060f9e6258e21da6342373878a12371776de547cf69424b61ae: Status 404 returned error can't find the container with id f2a8be82a048a060f9e6258e21da6342373878a12371776de547cf69424b61ae Jul 16 01:15:00.583994 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.583966 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd"] Jul 16 01:15:00.586492 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:15:00.586469 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc42605b_0e0d_4012_a57c_940d770915f3.slice/crio-53efeb6f450022ba4d34cb5310fbc48f196e43ac65fc845688324933dd43f56f WatchSource:0}: Error finding container 53efeb6f450022ba4d34cb5310fbc48f196e43ac65fc845688324933dd43f56f: Status 404 returned error can't find the container with id 53efeb6f450022ba4d34cb5310fbc48f196e43ac65fc845688324933dd43f56f Jul 16 01:15:00.977864 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.977779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" event={"ID":"6832a414-4ccf-499e-9151-ab0384fe0973","Type":"ContainerStarted","Data":"4893491cbee71b5e30177b275837f9c4dd29ae46fa0f6b74c31293b77a1b411a"} Jul 16 01:15:00.977864 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.977837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" event={"ID":"6832a414-4ccf-499e-9151-ab0384fe0973","Type":"ContainerStarted","Data":"7cb6ff702e88fa34866c18c7edc3c9aeea836c4730bc0f1e980175a25058fb0a"} Jul 16 01:15:00.979281 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.979252 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" event={"ID":"643dab73-e2b5-443b-bc8b-fe88ffc66c39","Type":"ContainerStarted","Data":"26cc5b6ec9b8fc6ab427fa301e05610e1bb078fadf0d7f2dc7812cc0ccbac2d3"} Jul 16 01:15:00.979416 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.979298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" event={"ID":"643dab73-e2b5-443b-bc8b-fe88ffc66c39","Type":"ContainerStarted","Data":"6a5ed6ae3282e396eb121f756b701901e8de43e394bd4034e0575a7f440b3c51"} Jul 16 01:15:00.980728 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.980702 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" event={"ID":"fc42605b-0e0d-4012-a57c-940d770915f3","Type":"ContainerStarted","Data":"7f36aa283cd536df95776232d1049c11d4a8accd8396e3d720c49606ff2cf0e3"} Jul 16 01:15:00.980843 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.980752 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" event={"ID":"fc42605b-0e0d-4012-a57c-940d770915f3","Type":"ContainerStarted","Data":"53efeb6f450022ba4d34cb5310fbc48f196e43ac65fc845688324933dd43f56f"} Jul 16 01:15:00.982195 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.982175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" event={"ID":"503d96ab-793c-44bc-ab99-0e1735682cfb","Type":"ContainerStarted","Data":"97cb53d989c1bf28c9cf0a5f3232ec788cadaa81c82faa79c2d21789cb95eb3a"} Jul 16 01:15:00.982297 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.982220 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" event={"ID":"503d96ab-793c-44bc-ab99-0e1735682cfb","Type":"ContainerStarted","Data":"8b6fddb34330db5ebd0ecae495aeff07324ee193de71a4ba697002050f0b476d"} Jul 16 01:15:00.983570 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.983547 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" event={"ID":"0cb2cb5e-bde7-4304-a0c2-65b84c33e375","Type":"ContainerStarted","Data":"2d44ab67ea3260ba367a37e7ad4ecb2da7ae505a9e595e3ebc8596a04bd01455"} Jul 16 01:15:00.983653 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.983588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" event={"ID":"0cb2cb5e-bde7-4304-a0c2-65b84c33e375","Type":"ContainerStarted","Data":"f2a8be82a048a060f9e6258e21da6342373878a12371776de547cf69424b61ae"} Jul 16 01:15:00.992819 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:00.992780 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" podStartSLOduration=0.992767144 podStartE2EDuration="992.767144ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:00.991804368 +0000 UTC m=+1838.183249907" watchObservedRunningTime="2026-07-16 01:15:00.992767144 +0000 UTC m=+1838.184212661" Jul 16 01:15:01.006087 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.006052 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" podStartSLOduration=1.00603923 podStartE2EDuration="1.00603923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.004588393 +0000 UTC m=+1838.196033943" watchObservedRunningTime="2026-07-16 01:15:01.00603923 +0000 UTC m=+1838.197484769" Jul 16 01:15:01.019152 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.019106 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" podStartSLOduration=1.01909084 podStartE2EDuration="1.01909084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.018731207 +0000 UTC m=+1838.210176747" watchObservedRunningTime="2026-07-16 01:15:01.01909084 +0000 UTC m=+1838.210536383" Jul 16 01:15:01.034089 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.034053 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" podStartSLOduration=1.034043069 podStartE2EDuration="1.034043069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.032889887 +0000 UTC m=+1838.224335451" watchObservedRunningTime="2026-07-16 01:15:01.034043069 +0000 UTC m=+1838.225488609" Jul 16 01:15:01.048557 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.048516 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" podStartSLOduration=1.048503405 podStartE2EDuration="1.048503405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:15:01.047365842 +0000 UTC m=+1838.238811382" watchObservedRunningTime="2026-07-16 01:15:01.048503405 +0000 UTC m=+1838.239948961" Jul 16 01:15:01.188315 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.188280 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:15:01.343471 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.343379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:01.407941 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.407914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:01.990674 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.990645 2573 generic.go:356] "Generic (PLEG): container finished" podID="fc42605b-0e0d-4012-a57c-940d770915f3" containerID="7f36aa283cd536df95776232d1049c11d4a8accd8396e3d720c49606ff2cf0e3" exitCode=0 Jul 16 01:15:01.990845 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.990733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" event={"ID":"fc42605b-0e0d-4012-a57c-940d770915f3","Type":"ContainerDied","Data":"7f36aa283cd536df95776232d1049c11d4a8accd8396e3d720c49606ff2cf0e3"} Jul 16 01:15:01.992201 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.992180 2573 generic.go:356] "Generic (PLEG): container finished" podID="503d96ab-793c-44bc-ab99-0e1735682cfb" containerID="97cb53d989c1bf28c9cf0a5f3232ec788cadaa81c82faa79c2d21789cb95eb3a" exitCode=0 Jul 16 01:15:01.992327 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.992260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" event={"ID":"503d96ab-793c-44bc-ab99-0e1735682cfb","Type":"ContainerDied","Data":"97cb53d989c1bf28c9cf0a5f3232ec788cadaa81c82faa79c2d21789cb95eb3a"} Jul 16 01:15:01.993708 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.993685 2573 generic.go:356] "Generic (PLEG): container finished" podID="0cb2cb5e-bde7-4304-a0c2-65b84c33e375" containerID="2d44ab67ea3260ba367a37e7ad4ecb2da7ae505a9e595e3ebc8596a04bd01455" exitCode=0 Jul 16 01:15:01.993806 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.993765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" event={"ID":"0cb2cb5e-bde7-4304-a0c2-65b84c33e375","Type":"ContainerDied","Data":"2d44ab67ea3260ba367a37e7ad4ecb2da7ae505a9e595e3ebc8596a04bd01455"} Jul 16 01:15:01.995175 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.995149 2573 generic.go:356] "Generic (PLEG): container finished" podID="6832a414-4ccf-499e-9151-ab0384fe0973" containerID="4893491cbee71b5e30177b275837f9c4dd29ae46fa0f6b74c31293b77a1b411a" exitCode=0 Jul 16 01:15:01.995270 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.995212 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" event={"ID":"6832a414-4ccf-499e-9151-ab0384fe0973","Type":"ContainerDied","Data":"4893491cbee71b5e30177b275837f9c4dd29ae46fa0f6b74c31293b77a1b411a"} Jul 16 01:15:01.996717 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.996697 2573 generic.go:356] "Generic (PLEG): container finished" podID="643dab73-e2b5-443b-bc8b-fe88ffc66c39" containerID="26cc5b6ec9b8fc6ab427fa301e05610e1bb078fadf0d7f2dc7812cc0ccbac2d3" exitCode=0 Jul 16 01:15:01.996815 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:01.996750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" event={"ID":"643dab73-e2b5-443b-bc8b-fe88ffc66c39","Type":"ContainerDied","Data":"26cc5b6ec9b8fc6ab427fa301e05610e1bb078fadf0d7f2dc7812cc0ccbac2d3"} Jul 16 01:15:02.045008 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:02.044986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:03.178438 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:03.178388 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" Jul 16 01:15:03.206365 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:03.206340 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" Jul 16 01:15:03.211029 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:03.211001 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" Jul 16 01:15:03.218603 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:03.218586 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" Jul 16 01:15:03.221599 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:03.221582 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" Jul 16 01:15:04.008245 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.008216 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" Jul 16 01:15:04.008446 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.008241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd" event={"ID":"fc42605b-0e0d-4012-a57c-940d770915f3","Type":"ContainerDied","Data":"53efeb6f450022ba4d34cb5310fbc48f196e43ac65fc845688324933dd43f56f"} Jul 16 01:15:04.008446 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.008302 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53efeb6f450022ba4d34cb5310fbc48f196e43ac65fc845688324933dd43f56f" Jul 16 01:15:04.009526 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.009505 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" Jul 16 01:15:04.009647 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.009533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq" event={"ID":"503d96ab-793c-44bc-ab99-0e1735682cfb","Type":"ContainerDied","Data":"8b6fddb34330db5ebd0ecae495aeff07324ee193de71a4ba697002050f0b476d"} Jul 16 01:15:04.009647 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.009576 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b6fddb34330db5ebd0ecae495aeff07324ee193de71a4ba697002050f0b476d" Jul 16 01:15:04.010838 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.010821 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" Jul 16 01:15:04.010942 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.010843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736075-gpl5d" event={"ID":"0cb2cb5e-bde7-4304-a0c2-65b84c33e375","Type":"ContainerDied","Data":"f2a8be82a048a060f9e6258e21da6342373878a12371776de547cf69424b61ae"} Jul 16 01:15:04.010942 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.010878 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2a8be82a048a060f9e6258e21da6342373878a12371776de547cf69424b61ae" Jul 16 01:15:04.012215 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.012196 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" Jul 16 01:15:04.012318 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.012211 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9" event={"ID":"6832a414-4ccf-499e-9151-ab0384fe0973","Type":"ContainerDied","Data":"7cb6ff702e88fa34866c18c7edc3c9aeea836c4730bc0f1e980175a25058fb0a"} Jul 16 01:15:04.012318 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.012249 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cb6ff702e88fa34866c18c7edc3c9aeea836c4730bc0f1e980175a25058fb0a" Jul 16 01:15:04.013705 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.013675 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" event={"ID":"643dab73-e2b5-443b-bc8b-fe88ffc66c39","Type":"ContainerDied","Data":"6a5ed6ae3282e396eb121f756b701901e8de43e394bd4034e0575a7f440b3c51"} Jul 16 01:15:04.013890 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.013712 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a5ed6ae3282e396eb121f756b701901e8de43e394bd4034e0575a7f440b3c51" Jul 16 01:15:04.013890 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:04.013682 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2" Jul 16 01:15:08.147847 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:08.147813 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:08.240949 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:08.240916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:08.420487 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:08.420413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:08.678926 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:08.678849 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:08.794642 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:08.794608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:08.894323 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:08.894289 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:09.004743 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:09.004673 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:13.193089 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:13.193057 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:15:14.967255 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:14.967218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:16.858982 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:16.858947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:21.424406 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:21.424357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:21.484453 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:21.484417 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:28.977623 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:28.977590 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:29.076965 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:29.076927 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:29.177253 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:29.177202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:29.941198 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:29.941161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:30.031168 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:30.031136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:30.135610 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:30.135585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:31.517584 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:31.517552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:32.189954 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:32.189921 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:15:33.531297 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:33.531263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:33.633731 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:33.633688 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:37.701636 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:37.701587 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:37.795448 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:37.795418 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:38.354021 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:38.353990 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:44.086225 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:44.086190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:44.189503 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:44.189464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:44.286070 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:44.286030 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:46.690363 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:46.690292 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:15:54.050269 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:54.050230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:54.825291 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:54.825254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:15:55.175360 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:15:55.175329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:16.150546 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:16.150515 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:22.058695 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:22.058659 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:22.158692 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:22.158659 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:22.469187 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:22.469154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:22.748286 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:22.748220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:23.010217 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:23.010135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:24.341653 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:24.341618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:24.429068 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:24.429027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:24.515172 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:24.515129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:24.609185 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:24.609097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:25.016801 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:25.016767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:25.117380 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:25.117342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:29.841500 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:29.841460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:30.195604 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:30.195573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:30.494763 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:30.494685 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:30.778516 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:30.778440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:32.366229 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:32.366175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:32.464904 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:32.464873 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:32.607516 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:32.607482 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:33.082738 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:33.082706 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:33.181456 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:33.181426 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:33.282412 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:33.282376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:34.189800 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:34.189768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:16:37.868529 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:37.868492 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:42.588522 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.588484 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf"] Jul 16 01:16:42.588977 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.588955 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc42605b-0e0d-4012-a57c-940d770915f3" containerName="cleanup" Jul 16 01:16:42.588977 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.588973 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc42605b-0e0d-4012-a57c-940d770915f3" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.588993 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503d96ab-793c-44bc-ab99-0e1735682cfb" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589001 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="503d96ab-793c-44bc-ab99-0e1735682cfb" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589012 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6832a414-4ccf-499e-9151-ab0384fe0973" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589022 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6832a414-4ccf-499e-9151-ab0384fe0973" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589052 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb2cb5e-bde7-4304-a0c2-65b84c33e375" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589061 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb2cb5e-bde7-4304-a0c2-65b84c33e375" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589081 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643dab73-e2b5-443b-bc8b-fe88ffc66c39" containerName="cleanup" Jul 16 01:16:42.589105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589090 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="643dab73-e2b5-443b-bc8b-fe88ffc66c39" containerName="cleanup" Jul 16 01:16:42.589538 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589172 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc42605b-0e0d-4012-a57c-940d770915f3" containerName="cleanup" Jul 16 01:16:42.589538 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589182 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="643dab73-e2b5-443b-bc8b-fe88ffc66c39" containerName="cleanup" Jul 16 01:16:42.589538 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589191 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6832a414-4ccf-499e-9151-ab0384fe0973" containerName="cleanup" Jul 16 01:16:42.589538 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589198 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb2cb5e-bde7-4304-a0c2-65b84c33e375" containerName="cleanup" Jul 16 01:16:42.589538 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.589204 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="503d96ab-793c-44bc-ab99-0e1735682cfb" containerName="cleanup" Jul 16 01:16:42.592118 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.592097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.594540 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.594518 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53347c\"/\"kube-root-ca.crt\"" Jul 16 01:16:42.595378 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.595361 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53347c\"/\"default-dockercfg-pvg2t\"" Jul 16 01:16:42.595479 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.595388 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53347c\"/\"openshift-service-ca.crt\"" Jul 16 01:16:42.595549 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.595364 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53347c\"/\"test-model-53347c-kserve-self-signed-certs\"" Jul 16 01:16:42.601110 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.601087 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf"] Jul 16 01:16:42.620845 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.620826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:42.692545 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.692518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-dshm\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.692646 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.692562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-home\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.692646 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.692584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c9690b-4eed-4ed1-81ab-bc4244758724-tls-certs\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.692720 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.692640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-tmp-dir\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.692720 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.692673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-model-cache\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.692720 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.692697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkz4\" (UniqueName: \"kubernetes.io/projected/48c9690b-4eed-4ed1-81ab-bc4244758724-kube-api-access-gjkz4\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.793846 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.793810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-model-cache\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794022 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.793857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkz4\" (UniqueName: \"kubernetes.io/projected/48c9690b-4eed-4ed1-81ab-bc4244758724-kube-api-access-gjkz4\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794022 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.793918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-dshm\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794022 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.793953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-home\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794022 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.793977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c9690b-4eed-4ed1-81ab-bc4244758724-tls-certs\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794022 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.794010 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-tmp-dir\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794375 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.794347 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-model-cache\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794513 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.794376 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-home\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.794513 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.794453 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-tmp-dir\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.796169 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.796143 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-dshm\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.796596 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.796573 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c9690b-4eed-4ed1-81ab-bc4244758724-tls-certs\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.802897 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.802860 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkz4\" (UniqueName: \"kubernetes.io/projected/48c9690b-4eed-4ed1-81ab-bc4244758724-kube-api-access-gjkz4\") pod \"test-model-53347c-kserve-7fbd9cdcd7-k92cf\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:42.902782 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:42.902751 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:43.045449 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:43.045420 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf"] Jul 16 01:16:43.047127 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:16:43.047097 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48c9690b_4eed_4ed1_81ab_bc4244758724.slice/crio-3ff047615f611ec22b1b8957d60bf6751337c7abd1a3d1f10af70b314b7affd6 WatchSource:0}: Error finding container 3ff047615f611ec22b1b8957d60bf6751337c7abd1a3d1f10af70b314b7affd6: Status 404 returned error can't find the container with id 3ff047615f611ec22b1b8957d60bf6751337c7abd1a3d1f10af70b314b7affd6 Jul 16 01:16:43.462516 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:43.462483 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" event={"ID":"48c9690b-4eed-4ed1-81ab-bc4244758724","Type":"ContainerStarted","Data":"5593699c6663faa1fe082ce1e0193c6bedbf2c721438800f9b4de63b7f616de7"} Jul 16 01:16:43.462672 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:43.462522 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" event={"ID":"48c9690b-4eed-4ed1-81ab-bc4244758724","Type":"ContainerStarted","Data":"3ff047615f611ec22b1b8957d60bf6751337c7abd1a3d1f10af70b314b7affd6"} Jul 16 01:16:43.481127 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:43.481080 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" podStartSLOduration=1.481064329 podStartE2EDuration="1.481064329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:16:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:16:43.478671176 +0000 UTC m=+1940.670116715" watchObservedRunningTime="2026-07-16 01:16:43.481064329 +0000 UTC m=+1940.672509887" Jul 16 01:16:46.945552 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:46.945514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:47.049267 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:47.049232 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:50.114907 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:50.114874 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:16:52.903115 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:52.903065 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:52.903115 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:52.903124 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:52.915635 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:52.915613 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:53.524077 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:53.524050 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:16:53.915642 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:53.915607 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:16:54.016565 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:16:54.016532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:06.031151 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:06.031109 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:10.398198 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:10.398156 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:17:29.292425 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:29.292331 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:17:36.571687 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:36.571652 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf"] Jul 16 01:17:36.590213 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:36.590178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:37.508389 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:37.508350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:37.965261 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:37.965227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:39.752429 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:39.752374 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:42.490836 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:42.490797 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:17:42.868237 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:42.868143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:42.968451 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:42.968419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:43.071259 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:43.071227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:17:51.591832 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.591777 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" podUID="48c9690b-4eed-4ed1-81ab-bc4244758724" containerName="main" containerID="cri-o://5593699c6663faa1fe082ce1e0193c6bedbf2c721438800f9b4de63b7f616de7" gracePeriod=45 Jul 16 01:17:51.782525 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.782494 2573 generic.go:356] "Generic (PLEG): container finished" podID="48c9690b-4eed-4ed1-81ab-bc4244758724" containerID="5593699c6663faa1fe082ce1e0193c6bedbf2c721438800f9b4de63b7f616de7" exitCode=0 Jul 16 01:17:51.782651 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.782520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" event={"ID":"48c9690b-4eed-4ed1-81ab-bc4244758724","Type":"ContainerDied","Data":"5593699c6663faa1fe082ce1e0193c6bedbf2c721438800f9b4de63b7f616de7"} Jul 16 01:17:51.838649 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.838624 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:17:51.871286 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871230 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-model-cache\") pod \"48c9690b-4eed-4ed1-81ab-bc4244758724\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " Jul 16 01:17:51.871286 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871271 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-home\") pod \"48c9690b-4eed-4ed1-81ab-bc4244758724\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " Jul 16 01:17:51.871484 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871327 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-dshm\") pod \"48c9690b-4eed-4ed1-81ab-bc4244758724\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " Jul 16 01:17:51.871484 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871350 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-tmp-dir\") pod \"48c9690b-4eed-4ed1-81ab-bc4244758724\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " Jul 16 01:17:51.871484 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871376 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c9690b-4eed-4ed1-81ab-bc4244758724-tls-certs\") pod \"48c9690b-4eed-4ed1-81ab-bc4244758724\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " Jul 16 01:17:51.871484 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871443 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjkz4\" (UniqueName: \"kubernetes.io/projected/48c9690b-4eed-4ed1-81ab-bc4244758724-kube-api-access-gjkz4\") pod \"48c9690b-4eed-4ed1-81ab-bc4244758724\" (UID: \"48c9690b-4eed-4ed1-81ab-bc4244758724\") " Jul 16 01:17:51.871687 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871580 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-model-cache" (OuterVolumeSpecName: "model-cache") pod "48c9690b-4eed-4ed1-81ab-bc4244758724" (UID: "48c9690b-4eed-4ed1-81ab-bc4244758724"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 01:17:51.871687 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871593 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-home" (OuterVolumeSpecName: "home") pod "48c9690b-4eed-4ed1-81ab-bc4244758724" (UID: "48c9690b-4eed-4ed1-81ab-bc4244758724"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 01:17:51.871687 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871636 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48c9690b-4eed-4ed1-81ab-bc4244758724" (UID: "48c9690b-4eed-4ed1-81ab-bc4244758724"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 01:17:51.871811 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871715 2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-model-cache\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:17:51.871811 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871732 2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-home\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:17:51.871811 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.871746 2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-tmp-dir\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:17:51.873482 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.873453 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-dshm" (OuterVolumeSpecName: "dshm") pod "48c9690b-4eed-4ed1-81ab-bc4244758724" (UID: "48c9690b-4eed-4ed1-81ab-bc4244758724"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 01:17:51.873596 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.873581 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c9690b-4eed-4ed1-81ab-bc4244758724-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48c9690b-4eed-4ed1-81ab-bc4244758724" (UID: "48c9690b-4eed-4ed1-81ab-bc4244758724"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 01:17:51.873902 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.873888 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c9690b-4eed-4ed1-81ab-bc4244758724-kube-api-access-gjkz4" (OuterVolumeSpecName: "kube-api-access-gjkz4") pod "48c9690b-4eed-4ed1-81ab-bc4244758724" (UID: "48c9690b-4eed-4ed1-81ab-bc4244758724"). InnerVolumeSpecName "kube-api-access-gjkz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:17:51.972301 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.972256 2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48c9690b-4eed-4ed1-81ab-bc4244758724-dshm\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:17:51.972301 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.972296 2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c9690b-4eed-4ed1-81ab-bc4244758724-tls-certs\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:17:51.972301 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:51.972308 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjkz4\" (UniqueName: \"kubernetes.io/projected/48c9690b-4eed-4ed1-81ab-bc4244758724-kube-api-access-gjkz4\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:17:52.789133 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:52.789103 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" Jul 16 01:17:52.789524 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:52.789097 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf" event={"ID":"48c9690b-4eed-4ed1-81ab-bc4244758724","Type":"ContainerDied","Data":"3ff047615f611ec22b1b8957d60bf6751337c7abd1a3d1f10af70b314b7affd6"} Jul 16 01:17:52.789524 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:52.789241 2573 scope.go:117] "RemoveContainer" containerID="5593699c6663faa1fe082ce1e0193c6bedbf2c721438800f9b4de63b7f616de7" Jul 16 01:17:52.809812 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:52.809787 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf"] Jul 16 01:17:52.813379 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:52.813358 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-53347c/test-model-53347c-kserve-7fbd9cdcd7-k92cf"] Jul 16 01:17:53.436274 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:17:53.436241 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c9690b-4eed-4ed1-81ab-bc4244758724" path="/var/lib/kubelet/pods/48c9690b-4eed-4ed1-81ab-bc4244758724/volumes" Jul 16 01:18:03.295155 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:03.295127 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:04.975125 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:04.975092 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:20.376115 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:20.376078 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:20.647049 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:20.647009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:20.883584 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:20.883552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:21.368101 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:21.368065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:24.491983 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:24.491940 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:18:27.549288 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:27.549256 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:27.615783 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:27.615751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:27.822203 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:27.822130 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:28.036031 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:28.035997 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:28.401351 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:28.401321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:28.716810 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:28.716741 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:28.838302 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:28.838272 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:31.077216 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.077180 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:31.168782 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.168751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:31.183230 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.183201 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w"] Jul 16 01:18:31.183559 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.183544 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c9690b-4eed-4ed1-81ab-bc4244758724" containerName="main" Jul 16 01:18:31.183626 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.183561 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c9690b-4eed-4ed1-81ab-bc4244758724" containerName="main" Jul 16 01:18:31.183626 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.183613 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c9690b-4eed-4ed1-81ab-bc4244758724" containerName="main" Jul 16 01:18:31.186467 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.186449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.188998 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.188982 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 01:18:31.189113 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.188980 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-314e69-serving-cert\"" Jul 16 01:18:31.189113 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.189025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 01:18:31.189562 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.189546 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4n4k8\"" Jul 16 01:18:31.199487 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.199465 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w"] Jul 16 01:18:31.278807 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.278778 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:31.295978 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.295950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8161339a-96f8-4a4a-9f79-7952cab9b650-openshift-service-ca\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.296100 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.295996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8161339a-96f8-4a4a-9f79-7952cab9b650-maas-api-tls\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.296100 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.296059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qq6\" (UniqueName: \"kubernetes.io/projected/8161339a-96f8-4a4a-9f79-7952cab9b650-kube-api-access-24qq6\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.397201 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.397170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qq6\" (UniqueName: \"kubernetes.io/projected/8161339a-96f8-4a4a-9f79-7952cab9b650-kube-api-access-24qq6\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.397377 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.397221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8161339a-96f8-4a4a-9f79-7952cab9b650-openshift-service-ca\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.397377 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.397265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8161339a-96f8-4a4a-9f79-7952cab9b650-maas-api-tls\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.397514 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:18:31.397406 2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-serving-cert: secret "maas-api-e2e-api-a-314e69-serving-cert" not found Jul 16 01:18:31.397514 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:18:31.397472 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8161339a-96f8-4a4a-9f79-7952cab9b650-maas-api-tls podName:8161339a-96f8-4a4a-9f79-7952cab9b650 nodeName:}" failed. No retries permitted until 2026-07-16 01:18:31.897452527 +0000 UTC m=+2049.088898064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8161339a-96f8-4a4a-9f79-7952cab9b650-maas-api-tls") pod "maas-api-e2e-api-a-314e69-5db4885485-5md2w" (UID: "8161339a-96f8-4a4a-9f79-7952cab9b650") : secret "maas-api-e2e-api-a-314e69-serving-cert" not found Jul 16 01:18:31.397871 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.397852 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8161339a-96f8-4a4a-9f79-7952cab9b650-openshift-service-ca\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.406119 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.406092 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qq6\" (UniqueName: \"kubernetes.io/projected/8161339a-96f8-4a4a-9f79-7952cab9b650-kube-api-access-24qq6\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.755932 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.755835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:31.858736 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.858707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:31.902719 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.902688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8161339a-96f8-4a4a-9f79-7952cab9b650-maas-api-tls\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:31.905049 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:31.905026 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8161339a-96f8-4a4a-9f79-7952cab9b650-maas-api-tls\") pod \"maas-api-e2e-api-a-314e69-5db4885485-5md2w\" (UID: \"8161339a-96f8-4a4a-9f79-7952cab9b650\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:32.096947 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:32.096866 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:32.226417 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:32.226347 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w"] Jul 16 01:18:32.229812 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:18:32.229771 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8161339a_96f8_4a4a_9f79_7952cab9b650.slice/crio-27d1bcfb9e2dd78318eb946884043fc2f1f8a7d4af992cb713583170aced4942 WatchSource:0}: Error finding container 27d1bcfb9e2dd78318eb946884043fc2f1f8a7d4af992cb713583170aced4942: Status 404 returned error can't find the container with id 27d1bcfb9e2dd78318eb946884043fc2f1f8a7d4af992cb713583170aced4942 Jul 16 01:18:32.231520 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:32.231500 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:18:32.972312 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:32.972273 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" event={"ID":"8161339a-96f8-4a4a-9f79-7952cab9b650","Type":"ContainerStarted","Data":"27d1bcfb9e2dd78318eb946884043fc2f1f8a7d4af992cb713583170aced4942"} Jul 16 01:18:34.984104 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:34.984070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" event={"ID":"8161339a-96f8-4a4a-9f79-7952cab9b650","Type":"ContainerStarted","Data":"366d7005cf00ae2acf375dd58cc913f4f7e92cc03ca8299c9f89ef6c477520eb"} Jul 16 01:18:34.984529 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:34.984180 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:35.002755 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:35.002682 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" podStartSLOduration=1.6983031880000001 podStartE2EDuration="4.002663443s" totalImagesPullingTime="2.304360255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:18:35.002020192 +0000 UTC m=+2052.193465758" watchObservedRunningTime="2026-07-16 01:18:35.002663443 +0000 UTC m=+2052.194108983" Jul 16 01:18:36.092865 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:36.092829 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:18:36.585315 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:36.585280 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:37.055766 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:37.055733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:37.362980 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:37.362878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:37.647123 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:37.647093 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:39.118628 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.118594 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:39.221538 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.221500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:39.290794 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.290762 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv"] Jul 16 01:18:39.294389 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.294369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.296883 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.296860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-edba78-serving-cert\"" Jul 16 01:18:39.308057 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.308036 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv"] Jul 16 01:18:39.344659 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.344633 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:39.363877 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.363849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7c47\" (UniqueName: \"kubernetes.io/projected/ca478c27-5f8f-486a-9253-8c162481733b-kube-api-access-r7c47\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.363987 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.363921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca478c27-5f8f-486a-9253-8c162481733b-openshift-service-ca\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.364028 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.363996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca478c27-5f8f-486a-9253-8c162481733b-maas-api-tls\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.464665 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.464635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca478c27-5f8f-486a-9253-8c162481733b-openshift-service-ca\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.464846 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.464694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca478c27-5f8f-486a-9253-8c162481733b-maas-api-tls\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.464846 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.464744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7c47\" (UniqueName: \"kubernetes.io/projected/ca478c27-5f8f-486a-9253-8c162481733b-kube-api-access-r7c47\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.465306 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.465284 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca478c27-5f8f-486a-9253-8c162481733b-openshift-service-ca\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.467069 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.467040 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca478c27-5f8f-486a-9253-8c162481733b-maas-api-tls\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.472995 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.472972 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7c47\" (UniqueName: \"kubernetes.io/projected/ca478c27-5f8f-486a-9253-8c162481733b-kube-api-access-r7c47\") pod \"maas-api-e2e-api-b-edba78-b697f5d55-pslkv\" (UID: \"ca478c27-5f8f-486a-9253-8c162481733b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.507815 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.507787 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:39.605057 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.605029 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:39.738190 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.738163 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv"] Jul 16 01:18:39.740405 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:18:39.740376 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca478c27_5f8f_486a_9253_8c162481733b.slice/crio-c39d2136f3f755f2bfe50c095fd236724fab055c7a800fd683a3d8fca7d2d4c0 WatchSource:0}: Error finding container c39d2136f3f755f2bfe50c095fd236724fab055c7a800fd683a3d8fca7d2d4c0: Status 404 returned error can't find the container with id c39d2136f3f755f2bfe50c095fd236724fab055c7a800fd683a3d8fca7d2d4c0 Jul 16 01:18:39.785489 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.785463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:39.886588 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:39.886557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:40.008140 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:40.008069 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" event={"ID":"ca478c27-5f8f-486a-9253-8c162481733b","Type":"ContainerStarted","Data":"c39d2136f3f755f2bfe50c095fd236724fab055c7a800fd683a3d8fca7d2d4c0"} Jul 16 01:18:40.994441 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:40.994413 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-314e69-5db4885485-5md2w" Jul 16 01:18:41.016948 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:41.016914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" event={"ID":"ca478c27-5f8f-486a-9253-8c162481733b","Type":"ContainerStarted","Data":"79f6d0801a79f0b85eece5b507703186182a60ddd0befc47bde17b934020a2e0"} Jul 16 01:18:41.017085 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:41.016986 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:41.035463 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:41.035415 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" podStartSLOduration=1.740860186 podStartE2EDuration="2.035357408s" totalImagesPullingTime="294.497222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:18:41.034553097 +0000 UTC m=+2058.225998638" watchObservedRunningTime="2026-07-16 01:18:41.035357408 +0000 UTC m=+2058.226802974" Jul 16 01:18:44.677057 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:44.677017 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:47.028984 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:47.028946 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-edba78-b697f5d55-pslkv" Jul 16 01:18:52.627668 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:52.627621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:52.727826 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:52.727784 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:53.018205 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:53.018130 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:18:54.796034 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:54.795998 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:18:59.156503 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:18:59.156472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:00.570865 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:00.570831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:00.671501 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:00.671469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:05.033830 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:05.033797 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:05.134569 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:05.134533 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:05.316645 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:05.316571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:05.549202 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:05.549172 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:05.999788 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:05.999761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:11.898018 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:11.897980 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:19:12.135889 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:12.135857 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:17.894382 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:17.894332 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:17.993807 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:17.993776 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:18.178078 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:18.178001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:18.423936 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:18.423893 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:18.762983 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:18.762944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:19.101818 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:19.101740 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:19.611444 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:19.611410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:21.373507 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.373467 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:21.458742 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.458711 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:21.459153 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.459130 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk"] Jul 16 01:19:21.467240 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.467218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.469594 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.469570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-44361b-serving-cert\"" Jul 16 01:19:21.471651 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.471629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk"] Jul 16 01:19:21.524369 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.524330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cft2n\" (UniqueName: \"kubernetes.io/projected/b29f310b-c437-4354-bc9d-d690c77fdce1-kube-api-access-cft2n\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.524595 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.524419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f310b-c437-4354-bc9d-d690c77fdce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.524595 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.524550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f310b-c437-4354-bc9d-d690c77fdce1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.533919 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.533892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:21.625956 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.625883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f310b-c437-4354-bc9d-d690c77fdce1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.625956 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.625930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cft2n\" (UniqueName: \"kubernetes.io/projected/b29f310b-c437-4354-bc9d-d690c77fdce1-kube-api-access-cft2n\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.626166 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.625963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f310b-c437-4354-bc9d-d690c77fdce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.626166 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:19:21.626083 2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-serving-cert: secret "maas-api-e2e-shared-a-44361b-serving-cert" not found Jul 16 01:19:21.626166 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:19:21.626136 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29f310b-c437-4354-bc9d-d690c77fdce1-maas-api-tls podName:b29f310b-c437-4354-bc9d-d690c77fdce1 nodeName:}" failed. No retries permitted until 2026-07-16 01:19:22.126118878 +0000 UTC m=+2099.317564395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b29f310b-c437-4354-bc9d-d690c77fdce1-maas-api-tls") pod "maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" (UID: "b29f310b-c437-4354-bc9d-d690c77fdce1") : secret "maas-api-e2e-shared-a-44361b-serving-cert" not found Jul 16 01:19:21.626517 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.626497 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29f310b-c437-4354-bc9d-d690c77fdce1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.637715 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.637688 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cft2n\" (UniqueName: \"kubernetes.io/projected/b29f310b-c437-4354-bc9d-d690c77fdce1-kube-api-access-cft2n\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:21.716039 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:21.716003 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:22.131956 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:22.131898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f310b-c437-4354-bc9d-d690c77fdce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:22.134253 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:22.134227 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29f310b-c437-4354-bc9d-d690c77fdce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk\" (UID: \"b29f310b-c437-4354-bc9d-d690c77fdce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:22.145050 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:22.145025 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:22.243698 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:22.243664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:22.381287 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:22.381252 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:22.513723 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:22.513699 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk"] Jul 16 01:19:22.515168 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:19:22.515142 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29f310b_c437_4354_bc9d_d690c77fdce1.slice/crio-0ab80036c0220c04bd04cf2fa39ac4db34a84a8ba1dda94c770a1e41591d8d24 WatchSource:0}: Error finding container 0ab80036c0220c04bd04cf2fa39ac4db34a84a8ba1dda94c770a1e41591d8d24: Status 404 returned error can't find the container with id 0ab80036c0220c04bd04cf2fa39ac4db34a84a8ba1dda94c770a1e41591d8d24 Jul 16 01:19:23.187112 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:23.187038 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:19:23.219139 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:23.219097 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" event={"ID":"b29f310b-c437-4354-bc9d-d690c77fdce1","Type":"ContainerStarted","Data":"8bac6890529120420c1af1ad3662b8780b1270a093e5abfe0677beedef983e0d"} Jul 16 01:19:23.219296 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:23.219205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" event={"ID":"b29f310b-c437-4354-bc9d-d690c77fdce1","Type":"ContainerStarted","Data":"0ab80036c0220c04bd04cf2fa39ac4db34a84a8ba1dda94c770a1e41591d8d24"} Jul 16 01:19:23.220091 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:23.220063 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:23.237727 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:23.237675 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" podStartSLOduration=1.870690172 podStartE2EDuration="2.2376606s" totalImagesPullingTime="366.970428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:19:23.237090457 +0000 UTC m=+2100.428535998" watchObservedRunningTime="2026-07-16 01:19:23.2376606 +0000 UTC m=+2100.429106138" Jul 16 01:19:25.013893 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:25.013781 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:19:25.021360 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:25.021340 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:19:26.889390 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:26.889356 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:27.238760 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:27.238689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:27.547446 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:27.547350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:27.947391 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:27.947351 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:29.458934 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.458898 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:29.553706 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.553655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:29.697264 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.697232 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p"] Jul 16 01:19:29.701253 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.701225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.706708 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.706674 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-908f0c-serving-cert\"" Jul 16 01:19:29.717367 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.717340 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p"] Jul 16 01:19:29.773358 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.773329 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:29.802649 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.802621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7n7h\" (UniqueName: \"kubernetes.io/projected/7fb18c0f-4083-4414-8f8e-933fa84c5103-kube-api-access-p7n7h\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.802773 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.802663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fb18c0f-4083-4414-8f8e-933fa84c5103-maas-api-tls\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.802773 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.802730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fb18c0f-4083-4414-8f8e-933fa84c5103-openshift-service-ca\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.903877 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.903845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7n7h\" (UniqueName: \"kubernetes.io/projected/7fb18c0f-4083-4414-8f8e-933fa84c5103-kube-api-access-p7n7h\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.904036 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.903881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fb18c0f-4083-4414-8f8e-933fa84c5103-maas-api-tls\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.904036 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.903928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fb18c0f-4083-4414-8f8e-933fa84c5103-openshift-service-ca\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.904155 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:19:29.904073 2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-serving-cert: secret "maas-api-e2e-shared-b-908f0c-serving-cert" not found Jul 16 01:19:29.904155 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:19:29.904140 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb18c0f-4083-4414-8f8e-933fa84c5103-maas-api-tls podName:7fb18c0f-4083-4414-8f8e-933fa84c5103 nodeName:}" failed. No retries permitted until 2026-07-16 01:19:30.404119905 +0000 UTC m=+2107.595565422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7fb18c0f-4083-4414-8f8e-933fa84c5103-maas-api-tls") pod "maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" (UID: "7fb18c0f-4083-4414-8f8e-933fa84c5103") : secret "maas-api-e2e-shared-b-908f0c-serving-cert" not found Jul 16 01:19:29.904702 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.904684 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fb18c0f-4083-4414-8f8e-933fa84c5103-openshift-service-ca\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:29.923863 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:29.923837 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7n7h\" (UniqueName: \"kubernetes.io/projected/7fb18c0f-4083-4414-8f8e-933fa84c5103-kube-api-access-p7n7h\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:30.122749 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.122680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:30.233142 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.233119 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk" Jul 16 01:19:30.342202 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.342170 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:30.408588 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.408558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fb18c0f-4083-4414-8f8e-933fa84c5103-maas-api-tls\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:30.410910 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.410879 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fb18c0f-4083-4414-8f8e-933fa84c5103-maas-api-tls\") pod \"maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p\" (UID: \"7fb18c0f-4083-4414-8f8e-933fa84c5103\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:30.443436 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.443387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:30.614755 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.614725 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:30.746858 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:30.746828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p"] Jul 16 01:19:30.750008 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:19:30.749978 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb18c0f_4083_4414_8f8e_933fa84c5103.slice/crio-63895e1ce2c5e1188ed88a9df1fa78e1ad0e3b6819e7f405dfdf617c44144c96 WatchSource:0}: Error finding container 63895e1ce2c5e1188ed88a9df1fa78e1ad0e3b6819e7f405dfdf617c44144c96: Status 404 returned error can't find the container with id 63895e1ce2c5e1188ed88a9df1fa78e1ad0e3b6819e7f405dfdf617c44144c96 Jul 16 01:19:31.257740 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:31.257712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" event={"ID":"7fb18c0f-4083-4414-8f8e-933fa84c5103","Type":"ContainerStarted","Data":"72843b441c9bc9b68535b06e9f1703b842f6a2e60acf17c78eb225a6f3a5e016"} Jul 16 01:19:31.257867 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:31.257764 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" event={"ID":"7fb18c0f-4083-4414-8f8e-933fa84c5103","Type":"ContainerStarted","Data":"63895e1ce2c5e1188ed88a9df1fa78e1ad0e3b6819e7f405dfdf617c44144c96"} Jul 16 01:19:31.257867 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:31.257791 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:31.276228 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:31.276182 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" podStartSLOduration=1.870934541 podStartE2EDuration="2.276165193s" totalImagesPullingTime="405.230652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 01:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:19:31.274852476 +0000 UTC m=+2108.466298064" watchObservedRunningTime="2026-07-16 01:19:31.276165193 +0000 UTC m=+2108.467610773" Jul 16 01:19:34.965683 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:34.965646 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:37.269501 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:37.269462 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p" Jul 16 01:19:41.200574 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:41.200534 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:19:43.838128 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:43.838089 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:43.937313 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:43.937278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:49.733638 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:49.733592 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:51.257026 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:51.256989 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:51.357300 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:51.357265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:19:55.497803 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:19:55.497763 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:20:19.340012 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:19.339927 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:20:23.400571 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:23.400536 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:20:34.327699 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:34.327661 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:20:34.429477 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:34.429445 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:20:38.122231 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:38.122197 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:20:38.184046 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:38.184016 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:20:39.193445 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:39.193407 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:20:57.400266 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:20:57.400228 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:21:18.400934 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:21:18.400889 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:21:37.097818 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:21:37.097782 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:21:57.597962 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:21:57.597882 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:22:18.298896 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:22:18.298861 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:22:29.703155 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:22:29.703117 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:22:30.697651 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:22:30.697609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:22:36.901130 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:22:36.901089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:22:46.826753 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:22:46.826718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:22:54.495844 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:22:54.495812 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:23:28.096697 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:23:28.096609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:23:33.189808 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:23:33.189768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:24:08.003505 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:08.003467 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:24:22.286958 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:22.286915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:24:23.110783 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:23.110750 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:24:25.042799 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:25.042683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:24:25.051533 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:25.051512 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gflb8_742556e8-796b-4231-bc39-e317f5289781/ovn-acl-logging/0.log" Jul 16 01:24:28.791037 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:28.791000 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:24:43.317075 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:43.317033 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:24:44.631602 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:44.631565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:24:44.732893 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:44.732854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:24:47.390167 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:47.390134 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:24:52.108365 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:52.108314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:24:52.207938 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:24:52.207901 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:25:12.268924 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:12.268881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:25:16.995937 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:16.995902 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:25:34.593334 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:34.593300 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:25:35.281516 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:35.281474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:25:36.944381 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:36.944343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:25:48.335039 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:48.335000 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:25:51.786010 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:51.785971 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:25:58.983105 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:58.983068 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:25:59.930510 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:25:59.930474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:00.870355 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:00.870324 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7348-139786011184688"] Jul 16 01:26:00.874911 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:00.874894 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:00.877580 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:00.877555 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wtk8p\"" Jul 16 01:26:00.882429 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:00.882386 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786011184688"] Jul 16 01:26:00.936532 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:00.936510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sn5h\" (UniqueName: \"kubernetes.io/projected/89a1e16e-bde1-4303-8bd6-3bcbe498185e-kube-api-access-6sn5h\") pod \"test-curl-7348-139786011184688\" (UID: \"89a1e16e-bde1-4303-8bd6-3bcbe498185e\") " pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:01.037586 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:01.037558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sn5h\" (UniqueName: \"kubernetes.io/projected/89a1e16e-bde1-4303-8bd6-3bcbe498185e-kube-api-access-6sn5h\") pod \"test-curl-7348-139786011184688\" (UID: \"89a1e16e-bde1-4303-8bd6-3bcbe498185e\") " pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:01.047093 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:01.047073 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sn5h\" (UniqueName: \"kubernetes.io/projected/89a1e16e-bde1-4303-8bd6-3bcbe498185e-kube-api-access-6sn5h\") pod \"test-curl-7348-139786011184688\" (UID: \"89a1e16e-bde1-4303-8bd6-3bcbe498185e\") " pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:01.184775 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:01.184740 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:01.314614 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:01.314588 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786011184688"] Jul 16 01:26:01.316300 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:26:01.316271 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89a1e16e_bde1_4303_8bd6_3bcbe498185e.slice/crio-cdbf41cec9f6e344505afb8a6fb0591499b815bb3fe45e39a9c873a67592a790 WatchSource:0}: Error finding container cdbf41cec9f6e344505afb8a6fb0591499b815bb3fe45e39a9c873a67592a790: Status 404 returned error can't find the container with id cdbf41cec9f6e344505afb8a6fb0591499b815bb3fe45e39a9c873a67592a790 Jul 16 01:26:01.317635 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:01.317613 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 01:26:02.105296 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:02.105271 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786011184688" event={"ID":"89a1e16e-bde1-4303-8bd6-3bcbe498185e","Type":"ContainerStarted","Data":"cdbf41cec9f6e344505afb8a6fb0591499b815bb3fe45e39a9c873a67592a790"} Jul 16 01:26:03.111208 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:03.111168 2573 generic.go:356] "Generic (PLEG): container finished" podID="89a1e16e-bde1-4303-8bd6-3bcbe498185e" containerID="657b995ac88760aa82a80e97815bc0a1924d360c2374612b1cacbd441810581e" exitCode=0 Jul 16 01:26:03.111613 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:03.111253 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786011184688" event={"ID":"89a1e16e-bde1-4303-8bd6-3bcbe498185e","Type":"ContainerDied","Data":"657b995ac88760aa82a80e97815bc0a1924d360c2374612b1cacbd441810581e"} Jul 16 01:26:04.247090 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.247066 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:04.270529 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.270502 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7348-139786011184688_89a1e16e-bde1-4303-8bd6-3bcbe498185e/test-curl-7348-139786011184688/0.log" Jul 16 01:26:04.296051 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.296015 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7348-139786011184688"] Jul 16 01:26:04.300512 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.300490 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7348-139786011184688"] Jul 16 01:26:04.368086 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.368021 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sn5h\" (UniqueName: \"kubernetes.io/projected/89a1e16e-bde1-4303-8bd6-3bcbe498185e-kube-api-access-6sn5h\") pod \"89a1e16e-bde1-4303-8bd6-3bcbe498185e\" (UID: \"89a1e16e-bde1-4303-8bd6-3bcbe498185e\") " Jul 16 01:26:04.370103 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.370080 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a1e16e-bde1-4303-8bd6-3bcbe498185e-kube-api-access-6sn5h" (OuterVolumeSpecName: "kube-api-access-6sn5h") pod "89a1e16e-bde1-4303-8bd6-3bcbe498185e" (UID: "89a1e16e-bde1-4303-8bd6-3bcbe498185e"). InnerVolumeSpecName "kube-api-access-6sn5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:26:04.469092 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:04.469058 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sn5h\" (UniqueName: \"kubernetes.io/projected/89a1e16e-bde1-4303-8bd6-3bcbe498185e-kube-api-access-6sn5h\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:26:05.122060 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:05.122028 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:05.122060 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:05.122047 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdbf41cec9f6e344505afb8a6fb0591499b815bb3fe45e39a9c873a67592a790" Jul 16 01:26:05.131411 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:26:05.131367 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7348-139786011184688\" is forbidden: User \"system:node:ip-10-0-138-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-126.ec2.internal' and this object" podUID="89a1e16e-bde1-4303-8bd6-3bcbe498185e" pod="opendatahub/test-curl-7348-139786011184688" Jul 16 01:26:05.436381 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:05.436345 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a1e16e-bde1-4303-8bd6-3bcbe498185e" path="/var/lib/kubelet/pods/89a1e16e-bde1-4303-8bd6-3bcbe498185e/volumes" Jul 16 01:26:07.801864 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.801832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:26:07.918549 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.918515 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:07.918856 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.918843 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a1e16e-bde1-4303-8bd6-3bcbe498185e" containerName="test-curl-7348-139786011184688" Jul 16 01:26:07.918905 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.918857 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a1e16e-bde1-4303-8bd6-3bcbe498185e" containerName="test-curl-7348-139786011184688" Jul 16 01:26:07.918948 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.918922 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a1e16e-bde1-4303-8bd6-3bcbe498185e" containerName="test-curl-7348-139786011184688" Jul 16 01:26:07.927176 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.927152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:07.930356 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.930327 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wtk8p\"" Jul 16 01:26:07.932317 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.932296 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:07.999355 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:07.999326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct875\" (UniqueName: \"kubernetes.io/projected/1821b854-bf9b-43b4-9252-f5e31088bbb6-kube-api-access-ct875\") pod \"test-curl-7348-139786016763168\" (UID: \"1821b854-bf9b-43b4-9252-f5e31088bbb6\") " pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:08.100180 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:08.100106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct875\" (UniqueName: \"kubernetes.io/projected/1821b854-bf9b-43b4-9252-f5e31088bbb6-kube-api-access-ct875\") pod \"test-curl-7348-139786016763168\" (UID: \"1821b854-bf9b-43b4-9252-f5e31088bbb6\") " pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:08.111501 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:08.111474 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct875\" (UniqueName: \"kubernetes.io/projected/1821b854-bf9b-43b4-9252-f5e31088bbb6-kube-api-access-ct875\") pod \"test-curl-7348-139786016763168\" (UID: \"1821b854-bf9b-43b4-9252-f5e31088bbb6\") " pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:08.236847 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:08.236811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:08.364549 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:08.364522 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:08.366377 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:26:08.366352 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1821b854_bf9b_43b4_9252_f5e31088bbb6.slice/crio-33cd58dbc8e5ec5500273b9bf6d18fe8b775bbf3aaf6f58638135694b4326556 WatchSource:0}: Error finding container 33cd58dbc8e5ec5500273b9bf6d18fe8b775bbf3aaf6f58638135694b4326556: Status 404 returned error can't find the container with id 33cd58dbc8e5ec5500273b9bf6d18fe8b775bbf3aaf6f58638135694b4326556 Jul 16 01:26:09.142342 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:09.142306 2573 generic.go:356] "Generic (PLEG): container finished" podID="1821b854-bf9b-43b4-9252-f5e31088bbb6" containerID="994d78b482f153c028f29742eb9fed79a4cbc5390cec91b6fb6342eb67d3a96d" exitCode=0 Jul 16 01:26:09.142667 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:09.142407 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016763168" event={"ID":"1821b854-bf9b-43b4-9252-f5e31088bbb6","Type":"ContainerDied","Data":"994d78b482f153c028f29742eb9fed79a4cbc5390cec91b6fb6342eb67d3a96d"} Jul 16 01:26:09.142667 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:09.142448 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016763168" event={"ID":"1821b854-bf9b-43b4-9252-f5e31088bbb6","Type":"ContainerStarted","Data":"33cd58dbc8e5ec5500273b9bf6d18fe8b775bbf3aaf6f58638135694b4326556"} Jul 16 01:26:10.278151 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.278123 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:10.302478 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.302452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7348-139786016763168_1821b854-bf9b-43b4-9252-f5e31088bbb6/test-curl-7348-139786016763168/0.log" Jul 16 01:26:10.328952 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.328921 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:10.332298 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.332277 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:10.420095 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.420019 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct875\" (UniqueName: \"kubernetes.io/projected/1821b854-bf9b-43b4-9252-f5e31088bbb6-kube-api-access-ct875\") pod \"1821b854-bf9b-43b4-9252-f5e31088bbb6\" (UID: \"1821b854-bf9b-43b4-9252-f5e31088bbb6\") " Jul 16 01:26:10.422106 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.422075 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1821b854-bf9b-43b4-9252-f5e31088bbb6-kube-api-access-ct875" (OuterVolumeSpecName: "kube-api-access-ct875") pod "1821b854-bf9b-43b4-9252-f5e31088bbb6" (UID: "1821b854-bf9b-43b4-9252-f5e31088bbb6"). InnerVolumeSpecName "kube-api-access-ct875". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:26:10.450457 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.450427 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:10.450773 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.450760 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1821b854-bf9b-43b4-9252-f5e31088bbb6" containerName="test-curl-7348-139786016763168" Jul 16 01:26:10.450829 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.450774 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1821b854-bf9b-43b4-9252-f5e31088bbb6" containerName="test-curl-7348-139786016763168" Jul 16 01:26:10.450866 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.450846 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1821b854-bf9b-43b4-9252-f5e31088bbb6" containerName="test-curl-7348-139786016763168" Jul 16 01:26:10.453787 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.453770 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:10.467263 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.467218 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:10.521668 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.521639 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd2jp\" (UniqueName: \"kubernetes.io/projected/58bf09ef-1431-49d9-b5e6-33def35d18ed-kube-api-access-sd2jp\") pod \"test-curl-7348-139786016763168\" (UID: \"58bf09ef-1431-49d9-b5e6-33def35d18ed\") " pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:10.521819 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.521707 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct875\" (UniqueName: \"kubernetes.io/projected/1821b854-bf9b-43b4-9252-f5e31088bbb6-kube-api-access-ct875\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:26:10.622345 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.622312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd2jp\" (UniqueName: \"kubernetes.io/projected/58bf09ef-1431-49d9-b5e6-33def35d18ed-kube-api-access-sd2jp\") pod \"test-curl-7348-139786016763168\" (UID: \"58bf09ef-1431-49d9-b5e6-33def35d18ed\") " pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:10.631479 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.631452 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd2jp\" (UniqueName: \"kubernetes.io/projected/58bf09ef-1431-49d9-b5e6-33def35d18ed-kube-api-access-sd2jp\") pod \"test-curl-7348-139786016763168\" (UID: \"58bf09ef-1431-49d9-b5e6-33def35d18ed\") " pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:10.762594 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.762532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:10.887576 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:10.887548 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:10.889500 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:26:10.889472 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58bf09ef_1431_49d9_b5e6_33def35d18ed.slice/crio-389f967b7dd204f37f621b89d7827aa0dc477123eec4110ca13f3acf33613a80 WatchSource:0}: Error finding container 389f967b7dd204f37f621b89d7827aa0dc477123eec4110ca13f3acf33613a80: Status 404 returned error can't find the container with id 389f967b7dd204f37f621b89d7827aa0dc477123eec4110ca13f3acf33613a80 Jul 16 01:26:11.153217 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:11.153186 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:11.153381 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:11.153231 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33cd58dbc8e5ec5500273b9bf6d18fe8b775bbf3aaf6f58638135694b4326556" Jul 16 01:26:11.154468 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:11.154441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016763168" event={"ID":"58bf09ef-1431-49d9-b5e6-33def35d18ed","Type":"ContainerStarted","Data":"389f967b7dd204f37f621b89d7827aa0dc477123eec4110ca13f3acf33613a80"} Jul 16 01:26:11.164584 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:11.164556 2573 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7348-139786016763168" oldPodUID="1821b854-bf9b-43b4-9252-f5e31088bbb6" podUID="58bf09ef-1431-49d9-b5e6-33def35d18ed" Jul 16 01:26:11.436065 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:11.435992 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1821b854-bf9b-43b4-9252-f5e31088bbb6" path="/var/lib/kubelet/pods/1821b854-bf9b-43b4-9252-f5e31088bbb6/volumes" Jul 16 01:26:12.160726 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:12.160691 2573 generic.go:356] "Generic (PLEG): container finished" podID="58bf09ef-1431-49d9-b5e6-33def35d18ed" containerID="bb7ef193c67db0f7c2bc82c1527c97418c128e5ea10210775b2f5a831b80f739" exitCode=0 Jul 16 01:26:12.160888 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:12.160754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016763168" event={"ID":"58bf09ef-1431-49d9-b5e6-33def35d18ed","Type":"ContainerDied","Data":"bb7ef193c67db0f7c2bc82c1527c97418c128e5ea10210775b2f5a831b80f739"} Jul 16 01:26:13.291992 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.291963 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:13.315618 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.315596 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7348-139786016763168_58bf09ef-1431-49d9-b5e6-33def35d18ed/test-curl-7348-139786016763168/0.log" Jul 16 01:26:13.343494 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.343474 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd2jp\" (UniqueName: \"kubernetes.io/projected/58bf09ef-1431-49d9-b5e6-33def35d18ed-kube-api-access-sd2jp\") pod \"58bf09ef-1431-49d9-b5e6-33def35d18ed\" (UID: \"58bf09ef-1431-49d9-b5e6-33def35d18ed\") " Jul 16 01:26:13.345459 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.345429 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58bf09ef-1431-49d9-b5e6-33def35d18ed-kube-api-access-sd2jp" (OuterVolumeSpecName: "kube-api-access-sd2jp") pod "58bf09ef-1431-49d9-b5e6-33def35d18ed" (UID: "58bf09ef-1431-49d9-b5e6-33def35d18ed"). InnerVolumeSpecName "kube-api-access-sd2jp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:26:13.348635 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.348612 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:13.354322 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.354298 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7348-139786016763168"] Jul 16 01:26:13.437205 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.437143 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58bf09ef-1431-49d9-b5e6-33def35d18ed" path="/var/lib/kubelet/pods/58bf09ef-1431-49d9-b5e6-33def35d18ed/volumes" Jul 16 01:26:13.444338 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.444219 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd2jp\" (UniqueName: \"kubernetes.io/projected/58bf09ef-1431-49d9-b5e6-33def35d18ed-kube-api-access-sd2jp\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:26:13.488047 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.488019 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7348-139786016801104"] Jul 16 01:26:13.488368 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.488355 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58bf09ef-1431-49d9-b5e6-33def35d18ed" containerName="test-curl-7348-139786016763168" Jul 16 01:26:13.488441 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.488370 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58bf09ef-1431-49d9-b5e6-33def35d18ed" containerName="test-curl-7348-139786016763168" Jul 16 01:26:13.488478 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.488468 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="58bf09ef-1431-49d9-b5e6-33def35d18ed" containerName="test-curl-7348-139786016763168" Jul 16 01:26:13.491566 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.491550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:13.495882 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.495854 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"] Jul 16 01:26:13.545038 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.545013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnrb\" (UniqueName: \"kubernetes.io/projected/efd0b4d5-1959-4c7c-81bb-757de3029327-kube-api-access-dhnrb\") pod \"test-curl-7348-139786016801104\" (UID: \"efd0b4d5-1959-4c7c-81bb-757de3029327\") " pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:13.645905 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.645875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnrb\" (UniqueName: \"kubernetes.io/projected/efd0b4d5-1959-4c7c-81bb-757de3029327-kube-api-access-dhnrb\") pod \"test-curl-7348-139786016801104\" (UID: \"efd0b4d5-1959-4c7c-81bb-757de3029327\") " pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:13.655250 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.655226 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnrb\" (UniqueName: \"kubernetes.io/projected/efd0b4d5-1959-4c7c-81bb-757de3029327-kube-api-access-dhnrb\") pod \"test-curl-7348-139786016801104\" (UID: \"efd0b4d5-1959-4c7c-81bb-757de3029327\") " pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:13.801379 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:13.801294 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:14.137506 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:14.137483 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"] Jul 16 01:26:14.139329 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:26:14.139306 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefd0b4d5_1959_4c7c_81bb_757de3029327.slice/crio-9d9b7bba636b96c4ffed00995f0395a48e90ab51865d80526730fc9ebb20b96a WatchSource:0}: Error finding container 9d9b7bba636b96c4ffed00995f0395a48e90ab51865d80526730fc9ebb20b96a: Status 404 returned error can't find the container with id 9d9b7bba636b96c4ffed00995f0395a48e90ab51865d80526730fc9ebb20b96a Jul 16 01:26:14.171093 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:14.170900 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016763168" Jul 16 01:26:14.171093 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:14.170900 2573 scope.go:117] "RemoveContainer" containerID="bb7ef193c67db0f7c2bc82c1527c97418c128e5ea10210775b2f5a831b80f739" Jul 16 01:26:14.172261 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:14.172231 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016801104" event={"ID":"efd0b4d5-1959-4c7c-81bb-757de3029327","Type":"ContainerStarted","Data":"9d9b7bba636b96c4ffed00995f0395a48e90ab51865d80526730fc9ebb20b96a"} Jul 16 01:26:15.179533 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:15.179461 2573 generic.go:356] "Generic (PLEG): container finished" podID="efd0b4d5-1959-4c7c-81bb-757de3029327" containerID="d29fbb840f3e0a112b92e882d28f108219cf9fef4811491ea32edb2af1f80c70" exitCode=0 Jul 16 01:26:15.179533 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:15.179511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7348-139786016801104" event={"ID":"efd0b4d5-1959-4c7c-81bb-757de3029327","Type":"ContainerDied","Data":"d29fbb840f3e0a112b92e882d28f108219cf9fef4811491ea32edb2af1f80c70"} Jul 16 01:26:16.317381 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.317350 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:16.343051 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.343029 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7348-139786016801104_efd0b4d5-1959-4c7c-81bb-757de3029327/test-curl-7348-139786016801104/0.log" Jul 16 01:26:16.369532 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.369506 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"] Jul 16 01:26:16.369667 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.369648 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhnrb\" (UniqueName: \"kubernetes.io/projected/efd0b4d5-1959-4c7c-81bb-757de3029327-kube-api-access-dhnrb\") pod \"efd0b4d5-1959-4c7c-81bb-757de3029327\" (UID: \"efd0b4d5-1959-4c7c-81bb-757de3029327\") " Jul 16 01:26:16.371558 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.371538 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efd0b4d5-1959-4c7c-81bb-757de3029327-kube-api-access-dhnrb" (OuterVolumeSpecName: "kube-api-access-dhnrb") pod "efd0b4d5-1959-4c7c-81bb-757de3029327" (UID: "efd0b4d5-1959-4c7c-81bb-757de3029327"). InnerVolumeSpecName "kube-api-access-dhnrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 01:26:16.374123 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.374102 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7348-139786016801104"] Jul 16 01:26:16.471312 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:16.471260 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhnrb\" (UniqueName: \"kubernetes.io/projected/efd0b4d5-1959-4c7c-81bb-757de3029327-kube-api-access-dhnrb\") on node \"ip-10-0-138-126.ec2.internal\" DevicePath \"\"" Jul 16 01:26:17.191065 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:17.191037 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:17.191065 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:17.191050 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d9b7bba636b96c4ffed00995f0395a48e90ab51865d80526730fc9ebb20b96a" Jul 16 01:26:17.202528 ip-10-0-138-126 kubenswrapper[2573]: E0716 01:26:17.202501 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7348-139786016801104\" is forbidden: User \"system:node:ip-10-0-138-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-126.ec2.internal' and this object" podUID="efd0b4d5-1959-4c7c-81bb-757de3029327" pod="opendatahub/test-curl-7348-139786016801104" Jul 16 01:26:17.435660 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:17.435631 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efd0b4d5-1959-4c7c-81bb-757de3029327" path="/var/lib/kubelet/pods/efd0b4d5-1959-4c7c-81bb-757de3029327/volumes" Jul 16 01:26:19.678477 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:19.678434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:25.864553 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:25.864516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:25.964688 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:25.964653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:26.148817 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:26.148782 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:26.367061 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:26.367019 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:26.832070 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:26.832027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:28.891764 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:28.891731 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:26:32.882444 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:32.882385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:32.982477 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:32.982439 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:33.151470 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:33.150809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:33.374355 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:33.374322 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:39.895971 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:39.895935 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bzn5c"] Jul 16 01:26:40.095867 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:40.095841 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-jrkzx_6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a/copy-manifests/0.log" Jul 16 01:26:40.115294 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:40.115256 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-jrkzx_6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a/manager/0.log" Jul 16 01:26:40.712707 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:40.712672 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-314e69-5db4885485-5md2w_8161339a-96f8-4a4a-9f79-7952cab9b650/maas-api/0.log" Jul 16 01:26:40.832253 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:40.832220 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-edba78-b697f5d55-pslkv_ca478c27-5f8f-486a-9253-8c162481733b/maas-api/0.log" Jul 16 01:26:41.565686 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:41.565653 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-44361b-7f985c8786-t6jpk_b29f310b-c437-4354-bc9d-d690c77fdce1/maas-api/0.log" Jul 16 01:26:41.685081 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:41.685050 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-908f0c-7f69778749-qjr6p_7fb18c0f-4083-4414-8f8e-933fa84c5103/maas-api/0.log" Jul 16 01:26:41.801584 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:41.801554 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736060-mlqst_cab42efd-d4b1-4dc7-bb71-cb8ddf1cde6b/cleanup/0.log" Jul 16 01:26:41.913661 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:41.913632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736075-gpl5d_0cb2cb5e-bde7-4304-a0c2-65b84c33e375/cleanup/0.log" Jul 16 01:26:42.020474 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:42.020447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-f9c9a9ad-29736075-kszwq_503d96ab-793c-44bc-ab99-0e1735682cfb/cleanup/0.log" Jul 16 01:26:42.129356 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:42.129323 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-derive-f122a48d-29736075-7sxr2_643dab73-e2b5-443b-bc8b-fe88ffc66c39/cleanup/0.log" Jul 16 01:26:42.239443 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:42.239353 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-389a944b-29736075-9wdzd_fc42605b-0e0d-4012-a57c-940d770915f3/cleanup/0.log" Jul 16 01:26:42.353197 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:42.353154 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-mt-54ada037-29736075-959f9_6832a414-4ccf-499e-9151-ab0384fe0973/cleanup/0.log" Jul 16 01:26:44.491196 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:44.491167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bzn5c_65fc0c1c-fb9d-4ae5-84a4-867375fba024/limitador/0.log" Jul 16 01:26:44.780979 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:44.780884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:44.840045 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:44.840011 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:45.095733 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:45.095659 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8nk6j_f390fe65-e063-42d6-94a5-437f46dfe8d3/discovery/0.log" Jul 16 01:26:46.378994 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:46.378957 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tvf7d_4c166970-0705-4e67-8ab6-6cdcda0c2003/main/0.log" Jul 16 01:26:46.603164 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:46.603130 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zl9dn_86427836-d4df-4579-9f89-892c74eb633e/main/0.log" Jul 16 01:26:52.591806 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:52.591771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:52.694975 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:52.694943 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:26:55.546870 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:55.546839 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hwc2x_26cc39bb-eb04-4021-b504-4615d81e37db/global-pull-secret-syncer/0.log" Jul 16 01:26:55.641647 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:55.641617 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" Jul 16 01:26:55.737844 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:26:55.737819 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-126.ec2.internal_2ed51309d98dfb7011e0d41dbcc4027d/haproxy/0.log" Jul 16 01:27:01.499458 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:01.499426 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bzn5c_65fc0c1c-fb9d-4ae5-84a4-867375fba024/limitador/0.log" Jul 16 01:27:03.346194 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:03.346164 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pg2cf_5e437cc4-d28d-48e5-b716-52bf54372ca9/kube-state-metrics/0.log" Jul 16 01:27:03.378752 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:03.378726 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pg2cf_5e437cc4-d28d-48e5-b716-52bf54372ca9/kube-rbac-proxy-main/0.log" Jul 16 01:27:03.406673 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:03.406621 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pg2cf_5e437cc4-d28d-48e5-b716-52bf54372ca9/kube-rbac-proxy-self/0.log" Jul 16 01:27:03.502914 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:03.502846 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2l8s_859f47cd-4838-4be3-9057-ff0fee58f0b2/node-exporter/0.log" Jul 16 01:27:03.523837 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:03.523811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2l8s_859f47cd-4838-4be3-9057-ff0fee58f0b2/kube-rbac-proxy/0.log" Jul 16 01:27:03.544673 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:03.544651 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d2l8s_859f47cd-4838-4be3-9057-ff0fee58f0b2/init-textfile/0.log" Jul 16 01:27:04.086933 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.086903 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756c7977bf-hnmxb_f0837fb5-d00c-4f1e-8392-e9036dec8a3d/telemeter-client/0.log" Jul 16 01:27:04.112269 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.112245 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756c7977bf-hnmxb_f0837fb5-d00c-4f1e-8392-e9036dec8a3d/reload/0.log" Jul 16 01:27:04.136933 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.136899 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756c7977bf-hnmxb_f0837fb5-d00c-4f1e-8392-e9036dec8a3d/kube-rbac-proxy/0.log" Jul 16 01:27:04.175508 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.175489 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd5b8d595-k7dwv_98a044ea-22d8-43ff-b53d-fba37f2cd513/thanos-query/0.log" Jul 16 01:27:04.197040 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.197018 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd5b8d595-k7dwv_98a044ea-22d8-43ff-b53d-fba37f2cd513/kube-rbac-proxy-web/0.log" Jul 16 01:27:04.219440 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.219420 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd5b8d595-k7dwv_98a044ea-22d8-43ff-b53d-fba37f2cd513/kube-rbac-proxy/0.log" Jul 16 01:27:04.244374 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.244350 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd5b8d595-k7dwv_98a044ea-22d8-43ff-b53d-fba37f2cd513/prom-label-proxy/0.log" Jul 16 01:27:04.266692 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.266675 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd5b8d595-k7dwv_98a044ea-22d8-43ff-b53d-fba37f2cd513/kube-rbac-proxy-rules/0.log" Jul 16 01:27:04.290718 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:04.290698 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd5b8d595-k7dwv_98a044ea-22d8-43ff-b53d-fba37f2cd513/kube-rbac-proxy-metrics/0.log" Jul 16 01:27:05.764975 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.764936 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc"] Jul 16 01:27:05.765488 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.765468 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efd0b4d5-1959-4c7c-81bb-757de3029327" containerName="test-curl-7348-139786016801104" Jul 16 01:27:05.765576 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.765491 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="efd0b4d5-1959-4c7c-81bb-757de3029327" containerName="test-curl-7348-139786016801104" Jul 16 01:27:05.765633 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.765577 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="efd0b4d5-1959-4c7c-81bb-757de3029327" containerName="test-curl-7348-139786016801104" Jul 16 01:27:05.768507 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.768484 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.770788 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.770767 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld8p\"/\"kube-root-ca.crt\"" Jul 16 01:27:05.771407 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.771378 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bld8p\"/\"default-dockercfg-smqpt\"" Jul 16 01:27:05.771504 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.771380 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld8p\"/\"openshift-service-ca.crt\"" Jul 16 01:27:05.776213 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.776190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc"] Jul 16 01:27:05.875997 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.875971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-proc\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.876153 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.876009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-podres\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.876153 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.876038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-sys\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.876153 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.876053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-lib-modules\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.876291 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.876149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khggz\" (UniqueName: \"kubernetes.io/projected/143cecbc-52aa-48b7-ab22-eb99f19531a3-kube-api-access-khggz\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977269 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-sys\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977269 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977273 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-lib-modules\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khggz\" (UniqueName: \"kubernetes.io/projected/143cecbc-52aa-48b7-ab22-eb99f19531a3-kube-api-access-khggz\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-proc\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-podres\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977345 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-sys\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977461 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-proc\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977493 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977458 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-lib-modules\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.977750 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.977501 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/143cecbc-52aa-48b7-ab22-eb99f19531a3-podres\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:05.986377 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:05.986356 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khggz\" (UniqueName: \"kubernetes.io/projected/143cecbc-52aa-48b7-ab22-eb99f19531a3-kube-api-access-khggz\") pod \"perf-node-gather-daemonset-285jc\" (UID: \"143cecbc-52aa-48b7-ab22-eb99f19531a3\") " pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:06.079883 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.079786 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:06.209765 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.209742 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc"] Jul 16 01:27:06.211870 ip-10-0-138-126 kubenswrapper[2573]: W0716 01:27:06.211835 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod143cecbc_52aa_48b7_ab22_eb99f19531a3.slice/crio-e1316e04e71766e674ea79ce8e3fef91bc66f7a1523f253d3d2a7ae95e85a353 WatchSource:0}: Error finding container e1316e04e71766e674ea79ce8e3fef91bc66f7a1523f253d3d2a7ae95e85a353: Status 404 returned error can't find the container with id e1316e04e71766e674ea79ce8e3fef91bc66f7a1523f253d3d2a7ae95e85a353 Jul 16 01:27:06.442006 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.441979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" event={"ID":"143cecbc-52aa-48b7-ab22-eb99f19531a3","Type":"ContainerStarted","Data":"db250efe31072971189641faa3b89889d6e2fe6ad0068956baa1f79a1f624bae"} Jul 16 01:27:06.442130 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.442026 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" event={"ID":"143cecbc-52aa-48b7-ab22-eb99f19531a3","Type":"ContainerStarted","Data":"e1316e04e71766e674ea79ce8e3fef91bc66f7a1523f253d3d2a7ae95e85a353"} Jul 16 01:27:06.442130 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.442101 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:06.460255 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.460209 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" podStartSLOduration=1.460193434 podStartE2EDuration="1.460193434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 01:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 01:27:06.459494328 +0000 UTC m=+2563.650939874" watchObservedRunningTime="2026-07-16 01:27:06.460193434 +0000 UTC m=+2563.651638977" Jul 16 01:27:06.655812 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.655784 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-zw9zp_5e50f696-fe89-4519-b7fb-918e1c9bc12c/download-server/0.log" Jul 16 01:27:06.966013 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:06.965939 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k27h7_ce3c522d-bfc4-4ba7-a7eb-020ca08ada8c/konnectivity-agent/0.log" limit=1024 Jul 16 01:27:08.406415 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:08.406368 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hm5zb_f9bff045-b880-4e87-b650-19f6ae287d82/dns/0.log" Jul 16 01:27:08.426188 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:08.426167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hm5zb_f9bff045-b880-4e87-b650-19f6ae287d82/kube-rbac-proxy/0.log" Jul 16 01:27:08.447423 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:08.447385 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-48qqz_3bf34870-9894-4bbe-97cb-aa1d0f1b056f/dns-node-resolver/0.log" Jul 16 01:27:09.033358 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:09.033327 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7fb966bc88-d4lx7_851fdf54-bb7d-4e1b-be8c-0251dee4b514/registry/0.log" Jul 16 01:27:09.078560 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:09.078537 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x5x6g_079acca2-8fc9-4a09-8fbd-2e3b16d32b85/node-ca/0.log" Jul 16 01:27:10.212438 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:10.212408 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8nk6j_f390fe65-e063-42d6-94a5-437f46dfe8d3/discovery/0.log" Jul 16 01:27:11.167494 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:11.167468 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b46rm_93b30340-afc2-478e-8969-2ae3018a800d/serve-healthcheck-canary/0.log" Jul 16 01:27:11.784416 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:11.784371 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dgfc_a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7/kube-rbac-proxy/0.log" Jul 16 01:27:11.804536 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:11.804513 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dgfc_a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7/exporter/0.log" Jul 16 01:27:11.825080 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:11.825061 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dgfc_a57d8cb9-e46a-4c5f-b8fc-56ef251c31c7/extractor/0.log" Jul 16 01:27:12.456380 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:12.456357 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bld8p/perf-node-gather-daemonset-285jc" Jul 16 01:27:14.721668 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:14.721635 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-jrkzx_6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a/manager/0.log" Jul 16 01:27:14.740653 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:14.740632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-795c7898c9-jrkzx_6331d7f9-05f0-4abc-9ea6-6eb6b8fad31a/copy-manifests/0.log" Jul 16 01:27:16.221065 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:16.221038 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57c869f4fd-ddhj8_13dad44b-59a7-4499-958c-9a05b471ff89/manager/0.log" Jul 16 01:27:16.305852 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:16.305822 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8nk6j_f390fe65-e063-42d6-94a5-437f46dfe8d3/discovery/0.log" Jul 16 01:27:17.886714 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:17.886678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8nk6j_f390fe65-e063-42d6-94a5-437f46dfe8d3/discovery/0.log" Jul 16 01:27:22.818491 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.818459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/kube-multus-additional-cni-plugins/0.log" Jul 16 01:27:22.844575 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.844553 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/egress-router-binary-copy/0.log" Jul 16 01:27:22.867997 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.867972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/cni-plugins/0.log" Jul 16 01:27:22.898476 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.898453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/bond-cni-plugin/0.log" Jul 16 01:27:22.927602 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.927582 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/routeoverride-cni/0.log" Jul 16 01:27:22.954608 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.954588 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/whereabouts-cni-bincopy/0.log" Jul 16 01:27:22.977485 ip-10-0-138-126 kubenswrapper[2573]: I0716 01:27:22.977463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6s5sn_1f1c9d22-7170-432e-923c-0c54de461627/whereabouts-cni/0.log"