Jul 20 16:13:41.104986 ip-10-0-137-195 systemd[1]: Starting Kubernetes Kubelet... Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.552480 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557366 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557378 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557382 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557385 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557389 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557392 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557395 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:13:41.593908 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557398 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557401 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557403 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557406 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557409 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557412 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557414 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557417 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557420 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557422 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557435 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557438 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557441 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557443 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557446 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557448 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557453 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557457 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557460 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:13:41.596084 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557464 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557467 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557470 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557472 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557476 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557480 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557484 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557488 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557492 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557495 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557497 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557500 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557503 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557505 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557508 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557510 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557514 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557516 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557519 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:13:41.615444 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557522 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557525 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557528 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557530 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557533 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557536 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557539 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557541 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557544 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557546 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557549 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557551 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557554 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557557 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557560 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557564 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557567 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557569 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557572 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557574 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:13:41.646985 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557577 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:13:41.624983 ip-10-0-137-195 systemd[1]: Started Kubernetes Kubelet. Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557579 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557582 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557585 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557587 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557590 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557592 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557595 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557598 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557600 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557602 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557605 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557607 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557610 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557612 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557615 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557617 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557619 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557623 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557625 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:13:41.651275 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557628 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557630 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557633 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557636 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557638 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557641 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557645 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557648 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557650 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557653 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557656 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557658 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557661 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.557663 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558351 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558358 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558360 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558363 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558366 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558369 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:13:41.666683 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558371 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558374 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558377 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558379 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558382 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558384 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558387 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558390 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558392 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558395 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558397 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558400 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558403 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558405 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558408 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558410 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558412 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558416 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558419 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558421 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:13:41.681548 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558425 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558427 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558430 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558432 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558435 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558437 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558440 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558442 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558444 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558447 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558450 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558452 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558455 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558457 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558460 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558464 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558468 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558472 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558474 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:13:41.843351 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558478 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558482 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558485 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558488 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558491 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558495 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558497 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558500 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558503 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558506 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558508 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558511 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558514 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558517 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558519 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558522 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558525 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558528 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558531 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:13:41.863054 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558533 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558536 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558538 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558546 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558549 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558551 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558554 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558556 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558558 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558561 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558564 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558566 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558568 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558571 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558573 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558577 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558581 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558584 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558587 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:13:41.864348 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558591 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558594 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558597 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558599 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558602 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558605 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558607 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558610 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558612 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558614 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558617 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558619 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558622 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558624 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558626 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.558629 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559006 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559011 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559014 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559017 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:13:41.876138 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559020 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559022 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559025 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559027 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559030 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559033 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559035 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559038 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559041 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559044 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559046 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559049 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559052 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559054 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559057 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559059 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559062 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559065 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559067 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:13:41.876952 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559070 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559073 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559075 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559078 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559081 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559083 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559086 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559088 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559091 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559095 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559098 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559100 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559103 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559106 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559108 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559111 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559113 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559116 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559118 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559120 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:13:41.879517 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559123 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559125 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559128 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559131 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559133 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559136 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559139 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559141 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559143 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559146 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559148 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559150 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559153 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559158 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559161 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559163 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559166 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559168 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559170 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:13:41.880193 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559173 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559175 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559179 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559181 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559184 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559186 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559189 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559191 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559194 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559201 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559204 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559207 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559210 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559212 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559214 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559217 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559219 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559222 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559224 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559227 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:13:41.880779 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559229 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559232 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559236 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559240 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559243 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559245 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559251 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559254 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559256 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559259 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559261 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559264 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559266 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559269 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559273 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559278 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559282 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559349 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559356 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559362 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 16:13:41.881392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559368 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559374 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559379 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559388 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559395 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559399 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559403 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559406 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559410 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559413 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559416 2575 flags.go:64] FLAG: --cgroup-root="" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559418 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559421 2575 flags.go:64] FLAG: --client-ca-file="" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559425 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559428 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559432 2575 flags.go:64] FLAG: --cluster-domain="" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559435 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559438 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559442 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559446 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559449 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559452 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559455 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 16:13:41.881995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559459 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559462 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559465 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559469 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559472 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559475 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559479 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559482 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559484 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559487 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559490 2575 flags.go:64] FLAG: --enable-server="true" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559493 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559500 2575 flags.go:64] FLAG: --event-burst="100" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559503 2575 flags.go:64] FLAG: --event-qps="50" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559506 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559509 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559512 2575 flags.go:64] FLAG: --eviction-hard="" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559516 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559519 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559522 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559524 2575 flags.go:64] FLAG: --eviction-soft="" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559527 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559530 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559534 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559537 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 16:13:41.882623 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559540 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559543 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559547 2575 flags.go:64] FLAG: --feature-gates="" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559551 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559553 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559556 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559560 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559563 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559565 2575 flags.go:64] FLAG: --help="false" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559568 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559572 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559575 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559578 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559581 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559585 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559588 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559590 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559593 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559596 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559599 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559602 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559605 2575 flags.go:64] FLAG: --kube-reserved="" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559608 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559611 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 16:13:42.024374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559613 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559616 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559619 2575 flags.go:64] FLAG: --lock-file="" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559622 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559625 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559627 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559632 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559636 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559638 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559641 2575 flags.go:64] FLAG: --logging-format="text" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559645 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559648 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559651 2575 flags.go:64] FLAG: --manifest-url="" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559654 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559658 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559661 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559665 2575 flags.go:64] FLAG: --max-pods="110" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559668 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559672 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559675 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559678 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559680 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559683 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559686 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559693 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 16:13:42.025340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559696 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559699 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559702 2575 flags.go:64] FLAG: --pod-cidr="" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559704 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559709 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559712 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559715 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559718 2575 flags.go:64] FLAG: --port="10250" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559738 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559741 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9e25dc977a0736f" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559744 2575 flags.go:64] FLAG: --qos-reserved="" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559747 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559750 2575 flags.go:64] FLAG: --register-node="true" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559753 2575 flags.go:64] FLAG: --register-with-taints="" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559757 2575 flags.go:64] FLAG: --registry-burst="10" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559760 2575 flags.go:64] FLAG: --registry-qps="5" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559763 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559767 2575 flags.go:64] FLAG: --reserved-memory="" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559770 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559773 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559776 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559779 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559782 2575 flags.go:64] FLAG: --runonce="false" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559785 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559788 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 16:13:42.026176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559791 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559796 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559798 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559801 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559805 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559808 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559811 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559814 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559817 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559820 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559823 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559826 2575 flags.go:64] FLAG: --system-cgroups="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559828 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559834 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559837 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559839 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559843 2575 flags.go:64] FLAG: --tls-min-version="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559846 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559848 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559851 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559854 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559857 2575 flags.go:64] FLAG: --v="2" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559861 2575 flags.go:64] FLAG: --version="false" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559865 2575 flags.go:64] FLAG: --vmodule="" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559870 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 16:13:42.027012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.559873 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559978 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559982 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559986 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559989 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559991 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559994 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.559997 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560001 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560003 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560006 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560009 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560011 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560014 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560016 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560019 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560021 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560024 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560027 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560029 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:13:42.027867 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560032 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560035 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560037 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560040 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560042 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560045 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560047 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560050 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560052 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560055 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560057 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560061 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560064 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560066 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560069 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560071 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560074 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560076 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560079 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560081 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:13:42.028453 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560085 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560088 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560090 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560093 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560095 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560098 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560100 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560103 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560105 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560108 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560110 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560113 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560115 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560118 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560120 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560123 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560125 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560128 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560130 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560133 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:13:42.029010 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560135 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560138 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560140 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560144 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560147 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560150 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560153 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560155 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560158 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560160 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560163 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560165 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560169 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560172 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560175 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560177 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560180 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560182 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560185 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560187 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:13:42.029570 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560190 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560192 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560195 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560199 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560202 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560205 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560207 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560211 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560214 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560217 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560220 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560224 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560227 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560229 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560232 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560238 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560241 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560244 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:13:42.030122 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560247 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.560249 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.561224 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.568346 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.568363 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.568381 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.568391 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568462 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568467 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568470 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568473 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568476 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568479 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568484 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:13:42.030640 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568487 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568490 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568493 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568496 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568499 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568502 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568505 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568507 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568509 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568512 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568515 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568517 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568520 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568522 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568526 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568532 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568535 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568537 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568540 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568542 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:13:42.031090 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568545 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568547 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568555 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568558 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568561 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568564 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568567 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568569 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568572 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568574 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568577 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568579 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568582 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568584 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568587 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568589 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568592 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568594 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568597 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568600 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:13:42.031645 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568602 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568605 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568607 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568610 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568612 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568614 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568617 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568621 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568623 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568626 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568628 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568631 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568633 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568636 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568638 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568648 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568651 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568655 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568658 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:13:42.032197 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568661 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568663 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568666 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568669 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568672 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568674 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568677 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568680 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568682 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568685 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568687 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568690 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568692 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568695 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568697 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568700 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568702 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568704 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568707 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568710 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:13:42.032756 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568714 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568716 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568719 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568745 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568748 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568751 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568753 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568756 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568758 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568767 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568772 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568775 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568777 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.568782 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568917 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:13:42.035528 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568922 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568924 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568927 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568930 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568933 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568935 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568937 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568940 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568942 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568944 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568947 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568949 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568952 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568954 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568957 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568959 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568961 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568965 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568968 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568970 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:13:42.036153 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568973 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568975 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568978 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568980 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568983 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568985 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568987 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568995 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.568999 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569002 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569004 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569007 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569009 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569012 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569015 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569017 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569020 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569022 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569024 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569027 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:13:42.192318 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569029 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569032 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569034 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569037 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569039 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569042 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569046 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569049 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569052 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569056 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569059 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569062 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569065 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569067 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569070 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569073 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569075 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569078 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569080 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:13:42.193131 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569083 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569093 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569097 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569100 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569102 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569105 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569107 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569110 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569112 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569114 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569117 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569119 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569122 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569124 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569127 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569129 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569131 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569134 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569137 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:13:42.193744 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569139 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569142 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569146 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569150 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569153 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569155 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569158 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569161 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569163 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569166 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569168 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569171 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569173 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569175 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569179 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569189 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569192 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569194 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569197 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:13:42.194286 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:41.569199 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.569204 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.569330 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.571764 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.573709 2575 server.go:1019] "Starting client certificate rotation" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.573822 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.573859 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.576758 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.580145 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.591388 2575 log.go:25] "Validated CRI v1 runtime API" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.593881 2575 log.go:25] "Validated CRI v1 image API" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.594639 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 16:13:42.194951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.598963 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91a92b66-8452-44c8-bb28-9d7ec97df960:/dev/nvme0n1p3 91d03d74-8211-45f8-bce5-eca9b1816e5a:/dev/nvme0n1p4] Jul 20 16:13:42.195326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.598977 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.603026 2575 manager.go:216] Machine: {Timestamp:2026-07-20 16:13:41.602543368 +0000 UTC m=+0.374255514 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099837 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f24d46942eb043d72031e809aac67 SystemUUID:ec2f24d4-6942-eb04-3d72-031e809aac67 BootID:2a8d499c-926f-46a5-bf4a-82188973e222 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:5d:e2:f4:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:5d:e2:f4:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:7b:ea:01:05:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.603120 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.603186 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.605740 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.606083 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.606106 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 16:13:42.195391 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.606961 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.606971 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.606983 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.606997 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.608851 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.613595 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.613921 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.613955 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.613966 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.613983 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.613995 2575 kubelet.go:398] "Adding apiserver pod source" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.614007 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.614381 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.614469 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.616849 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.619215 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.619242 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620583 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620596 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620601 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620606 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620626 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620631 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620639 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620644 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620650 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620655 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620667 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.620672 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.621329 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.621335 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.624167 2575 server.go:1268] "Started kubelet" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.624268 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.624989 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.625178 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.626558 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.630141 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.631427 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.637486 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-195.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 16:13:42.195677 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.637529 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.637612 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.637461 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-195.ec2.internal.18c40b85cbd979d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-195.ec2.internal,UID:ip-10-0-137-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-195.ec2.internal,},FirstTimestamp:2026-07-20 16:13:41.624142297 +0000 UTC m=+0.395854442,LastTimestamp:2026-07-20 16:13:41.624142297 +0000 UTC m=+0.395854442,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-195.ec2.internal,}" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.640078 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.640081 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.640159 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.640857 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.640859 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.640878 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.641146 2575 factory.go:55] Registering systemd factory Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.641156 2575 factory.go:223] Registration of the systemd container factory successfully Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.641522 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.641530 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.642214 2575 factory.go:153] Registering CRI-O factory Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.642229 2575 factory.go:223] Registration of the crio container factory successfully Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.642275 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.642298 2575 factory.go:103] Registering Raw factory Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.642311 2575 manager.go:1196] Started watching for new ooms in manager Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.642586 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.642590 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.642667 2575 manager.go:349] Starting recovery of all containers Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.652652 2575 manager.go:354] Recovery completed Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.654105 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7lwm9" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.657374 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659070 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659099 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659111 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659266 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7lwm9" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659566 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659575 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659588 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.659589 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.196684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.662595 2575 policy_none.go:49] "None policy: Start" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.662607 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.662616 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.665301 2575 policy_none.go:47] "Start" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.665303 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.665390 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.665402 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712295 2575 manager.go:337] "Starting Device Plugin manager" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.712350 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712363 2575 server.go:87] "Starting device plugin registration server" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712585 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712598 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712661 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712781 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.712793 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.713195 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.713244 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.732278 2575 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2610 into the system container \"/system.slice\": " Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.812739 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.813593 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.813622 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.813634 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.813665 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.823746 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.823763 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-195.ec2.internal\": node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.875304 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.976432 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.979473 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.980589 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.980623 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.980643 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:41.980675 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:41.982851 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.077143 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.081285 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal"] Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.081341 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.088639 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.197571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.088665 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.088676 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.090966 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091115 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091690 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091698 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091718 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091719 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091753 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.091762 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.093990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.094010 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.094596 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.094617 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.094627 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.125254 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-195.ec2.internal\" not found" node="ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.129049 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-195.ec2.internal\" not found" node="ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.144202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a729a32735cfab01117e99e7a9c46943-config\") pod \"kube-apiserver-proxy-ip-10-0-137-195.ec2.internal\" (UID: \"a729a32735cfab01117e99e7a9c46943\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.144222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2559b74449d87fa26b15551c3779d44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal\" (UID: \"c2559b74449d87fa26b15551c3779d44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.144239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2559b74449d87fa26b15551c3779d44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal\" (UID: \"c2559b74449d87fa26b15551c3779d44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.198541 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.177703 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.245062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2559b74449d87fa26b15551c3779d44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal\" (UID: \"c2559b74449d87fa26b15551c3779d44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.245128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2559b74449d87fa26b15551c3779d44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal\" (UID: \"c2559b74449d87fa26b15551c3779d44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.245145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2559b74449d87fa26b15551c3779d44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal\" (UID: \"c2559b74449d87fa26b15551c3779d44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.245183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a729a32735cfab01117e99e7a9c46943-config\") pod \"kube-apiserver-proxy-ip-10-0-137-195.ec2.internal\" (UID: \"a729a32735cfab01117e99e7a9c46943\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.245212 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a729a32735cfab01117e99e7a9c46943-config\") pod \"kube-apiserver-proxy-ip-10-0-137-195.ec2.internal\" (UID: \"a729a32735cfab01117e99e7a9c46943\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.245155 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2559b74449d87fa26b15551c3779d44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal\" (UID: \"c2559b74449d87fa26b15551c3779d44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.370595 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.278165 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.498890 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.378604 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.498890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.429737 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.498890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.431833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.498890 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.478783 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.498890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.482170 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:13:42.629424 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.575919 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 16:13:42.629424 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.576018 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:13:42.629424 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.576064 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:13:42.629424 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.579103 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.765377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.665521 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 16:08:43 +0000 UTC" deadline="2027-12-22 08:12:22.162718939 +0000 UTC" Jul 20 16:13:42.765377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.665541 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12471h58m39.49718053s" Jul 20 16:13:42.765377 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:42.679654 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-195.ec2.internal\" not found" Jul 20 16:13:42.765377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.711859 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:13:42.765377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.732975 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:13:42.765377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.741227 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" Jul 20 16:13:42.766169 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.766094 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:13:44.538401 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.766924 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" Jul 20 16:13:44.538401 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:42.776327 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:13:45.072778 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:44.971488 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda729a32735cfab01117e99e7a9c46943.slice/crio-b40513b300a692dddbdea333679a1e6cfadcbc24ea2c27ffbd32de16dcf16fd6 WatchSource:0}: Error finding container b40513b300a692dddbdea333679a1e6cfadcbc24ea2c27ffbd32de16dcf16fd6: Status 404 returned error can't find the container with id b40513b300a692dddbdea333679a1e6cfadcbc24ea2c27ffbd32de16dcf16fd6 Jul 20 16:13:45.072778 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:44.971856 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2559b74449d87fa26b15551c3779d44.slice/crio-b9960f6af59c63f1d3cae32625fe610efa10fba2d519d79c778f5c6db3e2fd1b WatchSource:0}: Error finding container b9960f6af59c63f1d3cae32625fe610efa10fba2d519d79c778f5c6db3e2fd1b: Status 404 returned error can't find the container with id b9960f6af59c63f1d3cae32625fe610efa10fba2d519d79c778f5c6db3e2fd1b Jul 20 16:13:45.072778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:44.975388 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.229961 2575 apiserver.go:52] "Watching apiserver" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.238355 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.238701 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-tpr8l","kube-system/global-pull-secret-syncer-pbdpb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph","openshift-cluster-node-tuning-operator/tuned-87gvm","openshift-dns/node-resolver-hl66h","openshift-image-registry/node-ca-fcm8b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal","openshift-multus/multus-additional-cni-plugins-g6mkn","openshift-multus/multus-d8m4x","kube-system/konnectivity-agent-4tcvx","kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal","openshift-multus/network-metrics-daemon-gk5h7","openshift-network-diagnostics/network-check-target-bw2dc","openshift-network-operator/iptables-alerter-4jqrj"] Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.242472 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.244504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.244560 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.245256 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.245511 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.245579 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgxsl\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.246694 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.248853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.249216 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.249222 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.249245 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.249418 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcpg5\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.250977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.251321 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.251823 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g6wfj\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.251831 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.253250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.254115 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.254143 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-48jxw\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.254178 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.255369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.255758 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.255955 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8vx62\"" Jul 20 16:13:45.289262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.255969 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.255983 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.255955 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.257510 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.258223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.258550 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.258597 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2dkxn\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.258610 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.258743 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.260248 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.260480 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.260563 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.260598 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.260942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hbp9x\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.261217 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.262687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.264923 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.265327 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.265363 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.266752 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.266761 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.266805 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8spmc\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.266766 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.266810 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.267133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.267191 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.267494 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.267559 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.267559 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bckdt\"" Jul 20 16:13:45.290697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.268926 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-sys-fs\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36ac1415-8810-4f4b-988e-020515265b2c-konnectivity-ca\") pod \"konnectivity-agent-4tcvx\" (UID: \"36ac1415-8810-4f4b-988e-020515265b2c\") " pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd5wt\" (UniqueName: \"kubernetes.io/projected/cfa5de70-b89e-4ddf-bf04-0b883500e372-kube-api-access-zd5wt\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlnrc\" (UniqueName: \"kubernetes.io/projected/a4ee803d-c3da-442d-8041-6185d4b45655-kube-api-access-qlnrc\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4060d656-a1cd-4f03-92e1-5592b99589d0-host\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271182 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-host\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-device-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-system-cni-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-hostroot\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-modprobe-d\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysconfig\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysctl-conf\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.291569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-lib-modules\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-cni-multus\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ntsj\" (UniqueName: \"kubernetes.io/projected/5d339571-1443-4d3c-a53b-a5c84bbcdabb-kube-api-access-9ntsj\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36ac1415-8810-4f4b-988e-020515265b2c-agent-certs\") pod \"konnectivity-agent-4tcvx\" (UID: \"36ac1415-8810-4f4b-988e-020515265b2c\") " pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-var-lib-kubelet\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjw2g\" (UniqueName: \"kubernetes.io/projected/82a62bd8-4389-4086-9d6d-d913551d0e68-kube-api-access-zjw2g\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-cni-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-kubelet\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-etc-kubernetes\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6a98660-5137-4500-8539-0fe2a4193d33-host-slash\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4ee803d-c3da-442d-8041-6185d4b45655-hosts-file\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-systemd\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-tuned\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-cnibin\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-os-release\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271683 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-kubernetes\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysctl-d\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-run\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-sys\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-socket-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ee803d-c3da-442d-8041-6185d4b45655-tmp-dir\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4060d656-a1cd-4f03-92e1-5592b99589d0-serviceca\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfa5de70-b89e-4ddf-bf04-0b883500e372-tmp\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-registration-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjj9\" (UniqueName: \"kubernetes.io/projected/4060d656-a1cd-4f03-92e1-5592b99589d0-kube-api-access-qdjj9\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-socket-dir-parent\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.292797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-netns\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-cni-bin\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-multus-certs\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.271990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjthg\" (UniqueName: \"kubernetes.io/projected/f6a98660-5137-4500-8539-0fe2a4193d33-kube-api-access-xjthg\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.272035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d339571-1443-4d3c-a53b-a5c84bbcdabb-cni-binary-copy\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.272062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-k8s-cni-cncf-io\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.272078 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-conf-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.272093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-daemon-config\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.272107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6a98660-5137-4500-8539-0fe2a4193d33-iptables-alerter-script\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.293453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.290352 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xvxdv" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.297892 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xvxdv" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.338967 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.356795 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-var-lib-kubelet\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjw2g\" (UniqueName: \"kubernetes.io/projected/82a62bd8-4389-4086-9d6d-d913551d0e68-kube-api-access-zjw2g\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-cni-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-kubelet\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-etc-kubernetes\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjthg\" (UniqueName: \"kubernetes.io/projected/f6a98660-5137-4500-8539-0fe2a4193d33-kube-api-access-xjthg\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-node-log\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372985 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-var-lib-kubelet\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4ee803d-c3da-442d-8041-6185d4b45655-hosts-file\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373084 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4ee803d-c3da-442d-8041-6185d4b45655-hosts-file\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-etc-kubernetes\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.437850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-systemd\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-tuned\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373145 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-env-overrides\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-cni-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-systemd\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-cni-binary-copy\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysctl-d\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-run\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373346 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-socket-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-run\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ee803d-c3da-442d-8041-6185d4b45655-tmp-dir\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4060d656-a1cd-4f03-92e1-5592b99589d0-serviceca\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-multus-certs\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.438586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.372993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-kubelet\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-cni-bin\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373450 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysctl-d\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-multus-certs\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-socket-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-netns\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-cni-bin\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-systemd-units\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373569 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-netns\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-os-release\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-cni-bin\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-k8s-cni-cncf-io\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ee803d-c3da-442d-8041-6185d4b45655-tmp-dir\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.439128 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-run-k8s-cni-cncf-io\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36ac1415-8810-4f4b-988e-020515265b2c-konnectivity-ca\") pod \"konnectivity-agent-4tcvx\" (UID: \"36ac1415-8810-4f4b-988e-020515265b2c\") " pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373722 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlnrc\" (UniqueName: \"kubernetes.io/projected/a4ee803d-c3da-442d-8041-6185d4b45655-kube-api-access-qlnrc\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-slash\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-run-netns\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jxz\" (UniqueName: \"kubernetes.io/projected/cc35a328-6923-4e53-be30-b847b0217224-kube-api-access-t7jxz\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373821 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4060d656-a1cd-4f03-92e1-5592b99589d0-serviceca\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-device-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-system-cni-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-etc-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-device-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-kubelet-config\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.439658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373946 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-system-cni-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysconfig\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.373996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysctl-conf\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-lib-modules\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374025 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysconfig\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-cni-multus\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374067 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-host-var-lib-cni-multus\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374067 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntsj\" (UniqueName: \"kubernetes.io/projected/5d339571-1443-4d3c-a53b-a5c84bbcdabb-kube-api-access-9ntsj\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374107 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-lib-modules\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovnkube-config\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-sysctl-conf\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36ac1415-8810-4f4b-988e-020515265b2c-agent-certs\") pod \"konnectivity-agent-4tcvx\" (UID: \"36ac1415-8810-4f4b-988e-020515265b2c\") " pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.440111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6a98660-5137-4500-8539-0fe2a4193d33-host-slash\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-cnibin\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374229 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36ac1415-8810-4f4b-988e-020515265b2c-konnectivity-ca\") pod \"konnectivity-agent-4tcvx\" (UID: \"36ac1415-8810-4f4b-988e-020515265b2c\") " pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374239 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374241 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6a98660-5137-4500-8539-0fe2a4193d33-host-slash\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-os-release\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-cnibin\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-conf-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6a98660-5137-4500-8539-0fe2a4193d33-iptables-alerter-script\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-var-lib-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-cni-netd\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-kubernetes\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.440686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-os-release\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-conf-dir\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-sys\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-kubernetes\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374795 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-sys\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjj9\" (UniqueName: \"kubernetes.io/projected/4060d656-a1cd-4f03-92e1-5592b99589d0-kube-api-access-qdjj9\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.374983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-kubelet\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-cnibin\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfa5de70-b89e-4ddf-bf04-0b883500e372-tmp\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-registration-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375119 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6a98660-5137-4500-8539-0fe2a4193d33-iptables-alerter-script\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-socket-dir-parent\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375243 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-registration-dir\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-socket-dir-parent\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-system-cni-dir\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d339571-1443-4d3c-a53b-a5c84bbcdabb-cni-binary-copy\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-daemon-config\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-ovn\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-sys-fs\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375540 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd5wt\" (UniqueName: \"kubernetes.io/projected/cfa5de70-b89e-4ddf-bf04-0b883500e372-kube-api-access-zd5wt\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4060d656-a1cd-4f03-92e1-5592b99589d0-host\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-systemd\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-log-socket\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovn-node-metrics-cert\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlqb9\" (UniqueName: \"kubernetes.io/projected/5f3deb31-b87c-45e6-b2df-96cfc25514c1-kube-api-access-zlqb9\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-host\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-hostroot\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.441814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-dbus\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h56qq\" (UniqueName: \"kubernetes.io/projected/2c22a50f-4bc8-49ad-b79a-b3801170e739-kube-api-access-h56qq\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-modprobe-d\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovnkube-script-lib\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.375899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376175 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d339571-1443-4d3c-a53b-a5c84bbcdabb-multus-daemon-config\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376285 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82a62bd8-4389-4086-9d6d-d913551d0e68-sys-fs\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376426 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d339571-1443-4d3c-a53b-a5c84bbcdabb-cni-binary-copy\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376519 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-host\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376597 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d339571-1443-4d3c-a53b-a5c84bbcdabb-hostroot\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376659 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-modprobe-d\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.376689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4060d656-a1cd-4f03-92e1-5592b99589d0-host\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.377407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfa5de70-b89e-4ddf-bf04-0b883500e372-tmp\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.377432 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36ac1415-8810-4f4b-988e-020515265b2c-agent-certs\") pod \"konnectivity-agent-4tcvx\" (UID: \"36ac1415-8810-4f4b-988e-020515265b2c\") " pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.378895 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfa5de70-b89e-4ddf-bf04-0b883500e372-etc-tuned\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.442257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.381370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjthg\" (UniqueName: \"kubernetes.io/projected/f6a98660-5137-4500-8539-0fe2a4193d33-kube-api-access-xjthg\") pod \"iptables-alerter-4jqrj\" (UID: \"f6a98660-5137-4500-8539-0fe2a4193d33\") " pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.381419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjw2g\" (UniqueName: \"kubernetes.io/projected/82a62bd8-4389-4086-9d6d-d913551d0e68-kube-api-access-zjw2g\") pod \"aws-ebs-csi-driver-node-4ckph\" (UID: \"82a62bd8-4389-4086-9d6d-d913551d0e68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.381580 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.381598 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.381609 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.381691 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:45.881672555 +0000 UTC m=+3.038489823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.381832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlnrc\" (UniqueName: \"kubernetes.io/projected/a4ee803d-c3da-442d-8041-6185d4b45655-kube-api-access-qlnrc\") pod \"node-resolver-hl66h\" (UID: \"a4ee803d-c3da-442d-8041-6185d4b45655\") " pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.382589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjj9\" (UniqueName: \"kubernetes.io/projected/4060d656-a1cd-4f03-92e1-5592b99589d0-kube-api-access-qdjj9\") pod \"node-ca-fcm8b\" (UID: \"4060d656-a1cd-4f03-92e1-5592b99589d0\") " pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.382652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ntsj\" (UniqueName: \"kubernetes.io/projected/5d339571-1443-4d3c-a53b-a5c84bbcdabb-kube-api-access-9ntsj\") pod \"multus-d8m4x\" (UID: \"5d339571-1443-4d3c-a53b-a5c84bbcdabb\") " pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.442882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.383657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd5wt\" (UniqueName: \"kubernetes.io/projected/cfa5de70-b89e-4ddf-bf04-0b883500e372-kube-api-access-zd5wt\") pod \"tuned-87gvm\" (UID: \"cfa5de70-b89e-4ddf-bf04-0b883500e372\") " pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476090 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-cni-binary-copy\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476131 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-cni-bin\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-systemd-units\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-os-release\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476208 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-cni-bin\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476244 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-systemd-units\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-slash\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-os-release\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476281 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-run-netns\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-slash\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.476354 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476371 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-run-netns\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476355 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jxz\" (UniqueName: \"kubernetes.io/projected/cc35a328-6923-4e53-be30-b847b0217224-kube-api-access-t7jxz\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.476404 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:45.976392256 +0000 UTC m=+3.133209534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-etc-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-kubelet-config\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476484 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-etc-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovnkube-config\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-var-lib-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.545891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-cni-netd\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476546 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-kubelet-config\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-kubelet\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-cnibin\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-system-cni-dir\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-ovn\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-cnibin\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c22a50f-4bc8-49ad-b79a-b3801170e739-system-cni-dir\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-var-lib-openvswitch\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476655 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-cni-binary-copy\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-ovn\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-systemd\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476743 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-cni-netd\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.546642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-log-socket\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-log-socket\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476765 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-run-systemd\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovn-node-metrics-cert\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-kubelet\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476796 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqb9\" (UniqueName: \"kubernetes.io/projected/5f3deb31-b87c-45e6-b2df-96cfc25514c1-kube-api-access-zlqb9\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-dbus\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h56qq\" (UniqueName: \"kubernetes.io/projected/2c22a50f-4bc8-49ad-b79a-b3801170e739-kube-api-access-h56qq\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovnkube-script-lib\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-dbus\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.476981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-node-log\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.476982 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-node-log\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.477047 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:13:45.977029978 +0000 UTC m=+3.133847261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3deb31-b87c-45e6-b2df-96cfc25514c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477067 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-env-overrides\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477100 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovnkube-config\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovnkube-script-lib\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f3deb31-b87c-45e6-b2df-96cfc25514c1-env-overrides\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.477499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c22a50f-4bc8-49ad-b79a-b3801170e739-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.478483 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f3deb31-b87c-45e6-b2df-96cfc25514c1-ovn-node-metrics-cert\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.486910 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jxz\" (UniqueName: \"kubernetes.io/projected/cc35a328-6923-4e53-be30-b847b0217224-kube-api-access-t7jxz\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.487138 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlqb9\" (UniqueName: \"kubernetes.io/projected/5f3deb31-b87c-45e6-b2df-96cfc25514c1-kube-api-access-zlqb9\") pod \"ovnkube-node-tpr8l\" (UID: \"5f3deb31-b87c-45e6-b2df-96cfc25514c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.547757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.487698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h56qq\" (UniqueName: \"kubernetes.io/projected/2c22a50f-4bc8-49ad-b79a-b3801170e739-kube-api-access-h56qq\") pod \"multus-additional-cni-plugins-g6mkn\" (UID: \"2c22a50f-4bc8-49ad-b79a-b3801170e739\") " pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.553659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.561758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.563012 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ac1415_8810_4f4b_988e_020515265b2c.slice/crio-a0b89beeed4ff46b67ac29be7bcd7345e52046ed7979ad95acab7468e8ab1efb WatchSource:0}: Error finding container a0b89beeed4ff46b67ac29be7bcd7345e52046ed7979ad95acab7468e8ab1efb: Status 404 returned error can't find the container with id a0b89beeed4ff46b67ac29be7bcd7345e52046ed7979ad95acab7468e8ab1efb Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.569144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87gvm" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.572723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hl66h" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.577638 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a62bd8_4389_4086_9d6d_d913551d0e68.slice/crio-e4da72ba64d919a2d67568da2c91f8919941d6b26980b7dc7602832112d967ed WatchSource:0}: Error finding container e4da72ba64d919a2d67568da2c91f8919941d6b26980b7dc7602832112d967ed: Status 404 returned error can't find the container with id e4da72ba64d919a2d67568da2c91f8919941d6b26980b7dc7602832112d967ed Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.578128 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fcm8b" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.578489 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa5de70_b89e_4ddf_bf04_0b883500e372.slice/crio-70eec818a89efa438c378d6ba8ea594c5f23f08d5b29324a801d86a989d15f65 WatchSource:0}: Error finding container 70eec818a89efa438c378d6ba8ea594c5f23f08d5b29324a801d86a989d15f65: Status 404 returned error can't find the container with id 70eec818a89efa438c378d6ba8ea594c5f23f08d5b29324a801d86a989d15f65 Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.582868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8m4x" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.587373 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ee803d_c3da_442d_8041_6185d4b45655.slice/crio-5de20b75c35f65b56cbe20dcdc8dc9b3c7257971104916f15c7a13fb8ee279d4 WatchSource:0}: Error finding container 5de20b75c35f65b56cbe20dcdc8dc9b3c7257971104916f15c7a13fb8ee279d4: Status 404 returned error can't find the container with id 5de20b75c35f65b56cbe20dcdc8dc9b3c7257971104916f15c7a13fb8ee279d4 Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.593645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4060d656_a1cd_4f03_92e1_5592b99589d0.slice/crio-2030f641facfe3848d460943757ca71d9ce260ff2a17180eda51078e72a04d96 WatchSource:0}: Error finding container 2030f641facfe3848d460943757ca71d9ce260ff2a17180eda51078e72a04d96: Status 404 returned error can't find the container with id 2030f641facfe3848d460943757ca71d9ce260ff2a17180eda51078e72a04d96 Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.596090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4jqrj" Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.599605 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d339571_1443_4d3c_a53b_a5c84bbcdabb.slice/crio-6d430d3c6bdea568ab60ecb99b38140d759f864f4619293f66dc8be509b9856e WatchSource:0}: Error finding container 6d430d3c6bdea568ab60ecb99b38140d759f864f4619293f66dc8be509b9856e: Status 404 returned error can't find the container with id 6d430d3c6bdea568ab60ecb99b38140d759f864f4619293f66dc8be509b9856e Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.602945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" event={"ID":"82a62bd8-4389-4086-9d6d-d913551d0e68","Type":"ContainerStarted","Data":"e4da72ba64d919a2d67568da2c91f8919941d6b26980b7dc7602832112d967ed"} Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.603880 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4tcvx" event={"ID":"36ac1415-8810-4f4b-988e-020515265b2c","Type":"ContainerStarted","Data":"a0b89beeed4ff46b67ac29be7bcd7345e52046ed7979ad95acab7468e8ab1efb"} Jul 20 16:13:45.640983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.604858 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" event={"ID":"c2559b74449d87fa26b15551c3779d44","Type":"ContainerStarted","Data":"b9960f6af59c63f1d3cae32625fe610efa10fba2d519d79c778f5c6db3e2fd1b"} Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:13:45.605678 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a98660_5137_4500_8539_0fe2a4193d33.slice/crio-966ab7ec9f0311d0cb42ced5508a326987ca41c31e0ab2a943d78862928454ee WatchSource:0}: Error finding container 966ab7ec9f0311d0cb42ced5508a326987ca41c31e0ab2a943d78862928454ee: Status 404 returned error can't find the container with id 966ab7ec9f0311d0cb42ced5508a326987ca41c31e0ab2a943d78862928454ee Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.605936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" event={"ID":"a729a32735cfab01117e99e7a9c46943","Type":"ContainerStarted","Data":"b40513b300a692dddbdea333679a1e6cfadcbc24ea2c27ffbd32de16dcf16fd6"} Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.607118 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8m4x" event={"ID":"5d339571-1443-4d3c-a53b-a5c84bbcdabb","Type":"ContainerStarted","Data":"6d430d3c6bdea568ab60ecb99b38140d759f864f4619293f66dc8be509b9856e"} Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.607295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.608213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fcm8b" event={"ID":"4060d656-a1cd-4f03-92e1-5592b99589d0","Type":"ContainerStarted","Data":"2030f641facfe3848d460943757ca71d9ce260ff2a17180eda51078e72a04d96"} Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.609641 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hl66h" event={"ID":"a4ee803d-c3da-442d-8041-6185d4b45655","Type":"ContainerStarted","Data":"5de20b75c35f65b56cbe20dcdc8dc9b3c7257971104916f15c7a13fb8ee279d4"} Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.611094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87gvm" event={"ID":"cfa5de70-b89e-4ddf-bf04-0b883500e372","Type":"ContainerStarted","Data":"70eec818a89efa438c378d6ba8ea594c5f23f08d5b29324a801d86a989d15f65"} Jul 20 16:13:45.642317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.612375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" Jul 20 16:13:45.978888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.978679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:45.978888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.978736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:45.978888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:45.978784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:45.983300 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.983273 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:45.983398 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.983351 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:46.98333235 +0000 UTC m=+4.140149631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:45.991998 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.991694 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:13:45.991998 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.991720 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:13:45.991998 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.991734 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:45.991998 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.991826 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:46.991789174 +0000 UTC m=+4.148606439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:45.991998 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.991914 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:45.991998 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:45.991971 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:13:46.991954716 +0000 UTC m=+4.148771987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:46.301016 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.300909 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:08:45 +0000 UTC" deadline="2028-04-02 23:56:14.64532365 +0000 UTC" Jul 20 16:13:46.301016 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.300968 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14935h42m28.344359879s" Jul 20 16:13:46.596263 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.596190 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:46.596422 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:46.596316 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:46.627428 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.627344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerStarted","Data":"f095665efb9b15d9c04ff3e2fbcae420118842ce3d164df99aeca6bb5888e56b"} Jul 20 16:13:46.631259 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.631105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"5f502338ab66b3b39ce4b8c0cd985af69276a44049434eeda3e1b7841545cc37"} Jul 20 16:13:46.641203 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.641171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4jqrj" event={"ID":"f6a98660-5137-4500-8539-0fe2a4193d33","Type":"ContainerStarted","Data":"966ab7ec9f0311d0cb42ced5508a326987ca41c31e0ab2a943d78862928454ee"} Jul 20 16:13:46.695730 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.695700 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:13:46.987819 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:46.987747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:46.987968 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:46.987883 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:46.987968 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:46.987947 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:48.987927728 +0000 UTC m=+6.144745015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:47.089298 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:47.089007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:47.089298 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:47.089061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:47.089298 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.089224 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:47.089298 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.089278 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:13:49.089261387 +0000 UTC m=+6.246078657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:47.089691 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.089379 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:13:47.089691 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.089405 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:13:47.089691 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.089419 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:47.089691 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.089469 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:49.089452143 +0000 UTC m=+6.246269427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:47.302200 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:47.302080 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:08:45 +0000 UTC" deadline="2028-01-22 00:15:51.83413147 +0000 UTC" Jul 20 16:13:47.302200 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:47.302115 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13208h2m4.532020995s" Jul 20 16:13:47.599634 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:47.598892 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:47.599634 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.599037 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:47.599634 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:47.599427 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:47.599634 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:47.599517 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:48.595921 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:48.595890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:48.596345 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:48.596014 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:49.003507 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:49.003433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:49.003702 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.003552 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:49.003702 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.003609 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:53.00359461 +0000 UTC m=+10.160411893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:49.103842 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:49.103807 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:49.103992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:49.103860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:49.103992 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.103967 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:49.103992 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.103982 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:13:49.104149 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.104010 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:13:49.104149 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.104023 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:49.104149 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.104023 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:13:53.104004587 +0000 UTC m=+10.260821866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:49.104149 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.104085 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:13:53.104068467 +0000 UTC m=+10.260885739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:49.596118 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:49.596067 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:49.596548 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.596200 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:49.596548 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:49.596253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:49.596548 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:49.596340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:50.596200 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:50.596166 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:50.596558 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:50.596304 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:51.596829 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:51.596793 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:51.597261 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:51.596931 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:51.597261 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:51.596986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:51.597261 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:51.597100 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:52.596492 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:52.596461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:52.596721 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:52.596582 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:53.035072 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:53.034991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:53.035499 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.035135 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:53.035499 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.035208 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:01.03518755 +0000 UTC m=+18.192004816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:13:53.135876 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:53.135840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:53.136045 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:53.135947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:53.136045 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.136008 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:53.136141 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.136080 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:13:53.136141 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.136089 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:14:01.13606826 +0000 UTC m=+18.292885542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:13:53.136141 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.136097 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:13:53.136141 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.136111 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:53.136334 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.136161 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:01.136144307 +0000 UTC m=+18.292961586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:13:53.597022 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:53.596597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:53.597022 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:53.596646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:53.597022 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.596732 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:53.597022 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:53.596880 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:54.596547 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:54.596522 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:54.596997 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:54.596613 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:55.596303 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:55.596273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:55.596478 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:55.596276 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:55.596478 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:55.596412 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:55.596577 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:55.596473 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:56.596542 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:56.596502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:56.596747 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:56.596640 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:57.596308 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:57.596273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:57.596493 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:57.596428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:57.596493 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:57.596410 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:57.596584 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:57.596558 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:13:58.595949 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:58.595915 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:13:58.596392 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:58.596043 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:13:59.596353 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:59.596321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:13:59.596353 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:13:59.596354 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:13:59.596876 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:59.596454 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:13:59.597508 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:13:59.597466 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:00.595950 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:00.595922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:00.596158 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:00.596035 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:01.098005 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:01.097975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:01.098350 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.098118 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:14:01.098350 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.098177 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:17.098157115 +0000 UTC m=+34.254974394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:14:01.199167 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:01.199146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:01.199275 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:01.199199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:01.199313 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.199292 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:14:01.199313 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.199306 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:14:01.199377 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.199319 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:14:01.199377 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.199331 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:14:01.199377 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.199352 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:14:17.199333986 +0000 UTC m=+34.356151255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:14:01.199377 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.199369 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:17.199358967 +0000 UTC m=+34.356176234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:14:01.596107 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:01.596035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:01.596107 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:01.596074 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:01.596301 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.596153 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:01.596367 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:01.596295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:02.595746 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:02.595715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:02.596112 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:02.595819 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:03.597347 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:03.597114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:03.597774 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:03.597152 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:03.597774 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:03.597434 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:03.597774 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:03.597560 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:04.596574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:04.596540 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:04.596761 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:04.596683 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:05.595994 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.595975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:05.596266 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:05.596081 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:05.596266 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.596119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:05.596266 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:05.596181 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:05.686194 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.686166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8m4x" event={"ID":"5d339571-1443-4d3c-a53b-a5c84bbcdabb","Type":"ContainerStarted","Data":"647d465397cb152bc99814de3dfef466fa438c3bbbcfabbcef445b13346f3107"} Jul 20 16:14:05.690384 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.690358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87gvm" event={"ID":"cfa5de70-b89e-4ddf-bf04-0b883500e372","Type":"ContainerStarted","Data":"4609173730f9c07fdc2a108165f2014b1d85e61b7c3c51d0d69418bd27ffd505"} Jul 20 16:14:05.691612 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.691588 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" event={"ID":"a729a32735cfab01117e99e7a9c46943","Type":"ContainerStarted","Data":"c91b9a3bac2e7db5c2da2777a87090523babc529ac366838a8a17ac6327cb104"} Jul 20 16:14:05.693046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.693026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"92d55aeee4e918aee06b8d24de9789fae1d77062e8978ae3cd2bbfaa5cfc419c"} Jul 20 16:14:05.704943 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.704903 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d8m4x" podStartSLOduration=2.850859334 podStartE2EDuration="22.704890438s" totalImagesPullingTime="19.854031104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:05.704631586 +0000 UTC m=+22.861448870" watchObservedRunningTime="2026-07-20 16:14:05.704890438 +0000 UTC m=+22.861707725" Jul 20 16:14:05.718275 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.718231 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-195.ec2.internal" podStartSLOduration=21.718213771 podStartE2EDuration="21.718213771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:05.717964759 +0000 UTC m=+22.874782061" watchObservedRunningTime="2026-07-20 16:14:05.718213771 +0000 UTC m=+22.875031060" Jul 20 16:14:05.733760 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:05.733718 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-87gvm" podStartSLOduration=2.897701824 podStartE2EDuration="22.733705976s" totalImagesPullingTime="19.836004152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:05.733227943 +0000 UTC m=+22.890045232" watchObservedRunningTime="2026-07-20 16:14:05.733705976 +0000 UTC m=+22.890523274" Jul 20 16:14:06.596847 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.596702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:06.597384 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:06.596916 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:06.696278 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.696210 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fcm8b" event={"ID":"4060d656-a1cd-4f03-92e1-5592b99589d0","Type":"ContainerStarted","Data":"f62e5136e9bba647916216c3648d2f9ccda0c38fb7bc360dda288962ef958eae"} Jul 20 16:14:06.697610 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.697584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hl66h" event={"ID":"a4ee803d-c3da-442d-8041-6185d4b45655","Type":"ContainerStarted","Data":"2e10f59e906ef74575cb66da808d4bebd0350cb80404fcda2d7b22e48889aed7"} Jul 20 16:14:06.698936 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.698908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4tcvx" event={"ID":"36ac1415-8810-4f4b-988e-020515265b2c","Type":"ContainerStarted","Data":"217548d70dcc46de3ab0005991d693326f503475c5352f18e07c9cde630268a0"} Jul 20 16:14:06.700986 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.700874 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c22a50f-4bc8-49ad-b79a-b3801170e739" containerID="31b078a58ccce824585f31f2dbc26528349d808e1a2df33dc22e957e1e331fe9" exitCode=0 Jul 20 16:14:06.701068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.701025 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerDied","Data":"31b078a58ccce824585f31f2dbc26528349d808e1a2df33dc22e957e1e331fe9"} Jul 20 16:14:06.705512 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.705497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:14:06.705833 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.705813 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f3deb31-b87c-45e6-b2df-96cfc25514c1" containerID="b92cd1be7b4d84589f7a350ba128518010f1039f0c81bfd95d09386b4f682656" exitCode=1 Jul 20 16:14:06.705896 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.705875 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"43eaa3b25e0b895941fa221f0583461e638a1cb1dd5ae004706c73fea31dfdd7"} Jul 20 16:14:06.705947 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.705920 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"73855a978dd8f8eaf564e7f6357ec3446b349fe686b5d8bf7d048aa5f18231db"} Jul 20 16:14:06.705987 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.705949 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"93221c5d6e4656cd3b2dc30bd97b8cfbb91efa88dc0fb18687b834ebb60bf690"} Jul 20 16:14:06.705987 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.705975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"9a9b9e704793462d11cd71d00796cfedb4e7ad17fc60516fd55a9a6bce5e90ee"} Jul 20 16:14:06.706057 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.706001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerDied","Data":"b92cd1be7b4d84589f7a350ba128518010f1039f0c81bfd95d09386b4f682656"} Jul 20 16:14:06.707195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.707177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" event={"ID":"82a62bd8-4389-4086-9d6d-d913551d0e68","Type":"ContainerStarted","Data":"5878c977245b8d5c22ce0a1917cd4fcacbebd724b7bc99370f5cb045a9ee7562"} Jul 20 16:14:06.708570 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.708531 2575 generic.go:356] "Generic (PLEG): container finished" podID="c2559b74449d87fa26b15551c3779d44" containerID="ad97782091f6a64e27d20e5cc68ab8e1f6eaf133f3a2d07d37911fd7ee172801" exitCode=0 Jul 20 16:14:06.708659 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.708614 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" event={"ID":"c2559b74449d87fa26b15551c3779d44","Type":"ContainerDied","Data":"ad97782091f6a64e27d20e5cc68ab8e1f6eaf133f3a2d07d37911fd7ee172801"} Jul 20 16:14:06.709834 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.709813 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4jqrj" event={"ID":"f6a98660-5137-4500-8539-0fe2a4193d33","Type":"ContainerStarted","Data":"201a4547c598d550cf3aebd8673747fcf1df247aac2386dd810f69a7b6176128"} Jul 20 16:14:06.737363 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.737328 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fcm8b" podStartSLOduration=3.956283557 podStartE2EDuration="23.73731716s" totalImagesPullingTime="19.781033603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:06.714252675 +0000 UTC m=+23.871069961" watchObservedRunningTime="2026-07-20 16:14:06.73731716 +0000 UTC m=+23.894134512" Jul 20 16:14:06.737553 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.737533 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4tcvx" podStartSLOduration=3.9323359829999998 podStartE2EDuration="23.73752472s" totalImagesPullingTime="19.805188737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:06.737244442 +0000 UTC m=+23.894061728" watchObservedRunningTime="2026-07-20 16:14:06.73752472 +0000 UTC m=+23.894342007" Jul 20 16:14:06.753709 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.753669 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hl66h" podStartSLOduration=3.922390865 podStartE2EDuration="23.753653343s" totalImagesPullingTime="19.831262478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:06.753074639 +0000 UTC m=+23.909891926" watchObservedRunningTime="2026-07-20 16:14:06.753653343 +0000 UTC m=+23.910470632" Jul 20 16:14:06.790812 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:06.790780 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4jqrj" podStartSLOduration=4.00197573 podStartE2EDuration="23.790768945s" totalImagesPullingTime="19.788793215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:06.790660922 +0000 UTC m=+23.947478208" watchObservedRunningTime="2026-07-20 16:14:06.790768945 +0000 UTC m=+23.947586232" Jul 20 16:14:07.596348 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:07.596317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:07.596586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:07.596359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:07.596586 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:07.596455 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:07.596727 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:07.596579 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:07.713172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:07.713142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" event={"ID":"c2559b74449d87fa26b15551c3779d44","Type":"ContainerStarted","Data":"767d6d3172eb76e4896cda05e230d861d900eecb960147605ad15ee897268cb4"} Jul 20 16:14:08.284965 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.284940 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 16:14:08.344737 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.344646 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T16:14:08.284961473Z","UUID":"d16ae573-6a07-4ef2-9328-077c5c156c1a","Handler":null,"Name":"","Endpoint":""} Jul 20 16:14:08.347192 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.346951 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 16:14:08.347192 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.347009 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 16:14:08.596700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.596609 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:08.596853 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:08.596735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:08.718774 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.718746 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:14:08.719270 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.719246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"28cb8bab0861fcdc528618d0926db1ed0a207f59d80b8e7a025ccb76eb557533"} Jul 20 16:14:08.721152 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:08.721126 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" event={"ID":"82a62bd8-4389-4086-9d6d-d913551d0e68","Type":"ContainerStarted","Data":"8db94fe32540461805565ed037fc625e68ba28622ce4e2d91ca692030ee1d5bc"} Jul 20 16:14:09.009056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.008980 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:14:09.009515 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.009495 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:14:09.024313 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.024264 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-195.ec2.internal" podStartSLOduration=25.024247587 podStartE2EDuration="25.024247587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:07.727320491 +0000 UTC m=+24.884137779" watchObservedRunningTime="2026-07-20 16:14:09.024247587 +0000 UTC m=+26.181064875" Jul 20 16:14:09.596430 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.596399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:09.596631 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.596399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:09.596631 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:09.596544 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:09.596758 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:09.596608 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:09.723882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.723855 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:14:09.724419 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:09.724399 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4tcvx" Jul 20 16:14:10.596827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.596610 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:10.597010 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:10.596925 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:10.733339 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.733272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:14:10.734013 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.733743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"1f47760942e2e6fb5f39ca048c7cf2f3b673ace6282bc387dea4e0658c93b144"} Jul 20 16:14:10.734145 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.734101 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:14:10.734260 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.734234 2575 scope.go:117] "RemoveContainer" containerID="b92cd1be7b4d84589f7a350ba128518010f1039f0c81bfd95d09386b4f682656" Jul 20 16:14:10.734260 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.734260 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:14:10.734505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.734308 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:14:10.737739 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.737718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" event={"ID":"82a62bd8-4389-4086-9d6d-d913551d0e68","Type":"ContainerStarted","Data":"6043a18f01cea41aa5db559f482c356cdce6854d3f9383feaf1f4e7778c4bdcc"} Jul 20 16:14:10.752129 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.752112 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:14:10.753509 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.753486 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:14:10.785425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:10.785385 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ckph" podStartSLOduration=4.982097629 podStartE2EDuration="27.785369643s" totalImagesPullingTime="22.803272014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:10.78526316 +0000 UTC m=+27.942080448" watchObservedRunningTime="2026-07-20 16:14:10.785369643 +0000 UTC m=+27.942186929" Jul 20 16:14:11.596088 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:11.596059 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:11.596231 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:11.596192 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:11.596306 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:11.596245 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:11.596410 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:11.596389 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:11.747556 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:11.747534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:14:11.748199 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:11.748155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" event={"ID":"5f3deb31-b87c-45e6-b2df-96cfc25514c1","Type":"ContainerStarted","Data":"03ba9fbc6f45836d08dbc725a189e08185475969f655c354312caf7ff02f68eb"} Jul 20 16:14:11.791651 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:11.791273 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" podStartSLOduration=8.879656992 podStartE2EDuration="28.79125072s" totalImagesPullingTime="19.911593728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:11.785736886 +0000 UTC m=+28.942554173" watchObservedRunningTime="2026-07-20 16:14:11.79125072 +0000 UTC m=+28.948068008" Jul 20 16:14:12.596176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.596144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:12.596408 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:12.596376 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:12.797704 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.797672 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bw2dc"] Jul 20 16:14:12.798066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.797781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:12.798066 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:12.797865 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:12.800952 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.800926 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pbdpb"] Jul 20 16:14:12.801059 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.801024 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:12.801130 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:12.801114 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:12.801684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.801662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gk5h7"] Jul 20 16:14:12.801777 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:12.801761 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:12.801885 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:12.801862 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:13.756503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:13.756241 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c22a50f-4bc8-49ad-b79a-b3801170e739" containerID="7f0b9449ab6beff6c2b9166380c06424a7ee322ebe9ada1acee9099cd2c38254" exitCode=0 Jul 20 16:14:13.756503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:13.756327 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerDied","Data":"7f0b9449ab6beff6c2b9166380c06424a7ee322ebe9ada1acee9099cd2c38254"} Jul 20 16:14:14.596582 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:14.596527 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:14.596582 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:14.596559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:14.596582 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:14.596562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:14.597085 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:14.596659 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:14.597085 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:14.596790 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:14.597085 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:14.596881 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:15.762643 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:15.762559 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c22a50f-4bc8-49ad-b79a-b3801170e739" containerID="35d30479fd485231209a1961c762c6ff86a809031ac81038a55b52f1d568cc7b" exitCode=0 Jul 20 16:14:15.762643 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:15.762610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerDied","Data":"35d30479fd485231209a1961c762c6ff86a809031ac81038a55b52f1d568cc7b"} Jul 20 16:14:16.596436 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:16.596408 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:16.596436 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:16.596430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:16.596611 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:16.596408 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:16.596611 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:16.596498 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:16.596611 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:16.596583 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:16.596730 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:16.596672 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:17.116732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:17.116705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:17.117142 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.116859 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:14:17.117142 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.116926 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs podName:cc35a328-6923-4e53-be30-b847b0217224 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:49.116904708 +0000 UTC m=+66.273721973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs") pod "network-metrics-daemon-gk5h7" (UID: "cc35a328-6923-4e53-be30-b847b0217224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:14:17.217609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:17.217579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:17.217738 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:17.217641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:17.217800 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.217734 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:14:17.217800 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.217752 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:14:17.217800 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.217762 2575 projected.go:196] Error preparing data for projected volume kube-api-access-n428m for pod openshift-network-diagnostics/network-check-target-bw2dc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:14:17.217800 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.217779 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:14:17.217944 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.217808 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m podName:068b72d1-0d1b-4239-bcc5-4fa836f67953 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:49.217791848 +0000 UTC m=+66.374609114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n428m" (UniqueName: "kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m") pod "network-check-target-bw2dc" (UID: "068b72d1-0d1b-4239-bcc5-4fa836f67953") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:14:17.217944 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:17.217830 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret podName:5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e nodeName:}" failed. No retries permitted until 2026-07-20 16:14:49.217814341 +0000 UTC m=+66.374631607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret") pod "global-pull-secret-syncer-pbdpb" (UID: "5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:14:17.769410 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:17.769376 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c22a50f-4bc8-49ad-b79a-b3801170e739" containerID="ae0a5b43d0c10e324ff4043aaed17a67327ffbe5be6f73decac542090567f567" exitCode=0 Jul 20 16:14:17.769651 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:17.769427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerDied","Data":"ae0a5b43d0c10e324ff4043aaed17a67327ffbe5be6f73decac542090567f567"} Jul 20 16:14:18.596354 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.596097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:18.596784 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.596125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:18.596784 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:18.596399 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk5h7" podUID="cc35a328-6923-4e53-be30-b847b0217224" Jul 20 16:14:18.596784 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.596149 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:18.596784 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:18.596479 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pbdpb" podUID="5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e" Jul 20 16:14:18.596784 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:18.596533 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bw2dc" podUID="068b72d1-0d1b-4239-bcc5-4fa836f67953" Jul 20 16:14:18.640610 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.640585 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-195.ec2.internal" event="NodeReady" Jul 20 16:14:18.640770 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.640716 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 16:14:18.672537 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.672512 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz"] Jul 20 16:14:18.687126 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.687105 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9dd64b47-x7pq8"] Jul 20 16:14:18.687252 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.687233 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.690516 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.690441 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 16:14:18.690516 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.690469 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.690715 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.690520 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-krw8b\"" Jul 20 16:14:18.690715 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.690645 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 16:14:18.690836 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.690807 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.701344 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.701144 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m"] Jul 20 16:14:18.701464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.701445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.704162 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.704143 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 16:14:18.704759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.704740 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 16:14:18.704893 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.704863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 16:14:18.705002 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.704948 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5btcg\"" Jul 20 16:14:18.720268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.720242 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 16:14:18.721541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.721370 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b"] Jul 20 16:14:18.721739 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.721614 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" Jul 20 16:14:18.724918 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.724896 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.725127 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.725103 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.725293 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.725185 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fvdkd\"" Jul 20 16:14:18.739335 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.739314 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx"] Jul 20 16:14:18.739445 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.739428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.741894 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.741829 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 16:14:18.741991 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.741938 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 16:14:18.742053 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.741993 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xhcgs\"" Jul 20 16:14:18.742108 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.742080 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.742108 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.742097 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.759437 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.759417 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt"] Jul 20 16:14:18.759548 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.759532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:18.762444 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.762427 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 16:14:18.762715 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.762694 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.762802 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.762742 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.764081 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.764059 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c9xwf\"" Jul 20 16:14:18.764174 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.764123 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 16:14:18.773797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.773780 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-h9z4k"] Jul 20 16:14:18.773912 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.773895 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:18.776275 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.776256 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 16:14:18.776365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.776348 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wwxlp\"" Jul 20 16:14:18.776421 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.776390 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 16:14:18.797892 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.797873 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz"] Jul 20 16:14:18.797977 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.797962 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:18.800897 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.800554 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 16:14:18.800897 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.800555 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 16:14:18.800897 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.800695 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rfmhp\"" Jul 20 16:14:18.800897 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.800710 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.800897 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.800800 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.806364 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.806344 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 16:14:18.818048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.817948 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz"] Jul 20 16:14:18.818048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.817983 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m"] Jul 20 16:14:18.818048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.818002 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz"] Jul 20 16:14:18.818048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.818013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:18.818048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.818027 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d5689bf4d-xfpk9"] Jul 20 16:14:18.821952 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.821633 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zdsmt\"" Jul 20 16:14:18.822649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.822187 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.822649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.822311 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.822649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.822423 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 16:14:18.828809 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-registry-certificates\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.828888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-image-registry-private-configuration\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.828888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.829019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4be2c5-4708-4c5f-aa26-93a0c4385983-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.829019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vmcv\" (UniqueName: \"kubernetes.io/projected/ec4be2c5-4708-4c5f-aa26-93a0c4385983-kube-api-access-5vmcv\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.829019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-trusted-ca\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.829019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff66143e-68d5-4d85-b36e-ece5c16b0583-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.829019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.828992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhw6d\" (UniqueName: \"kubernetes.io/projected/7e6961fd-69bc-4e1c-9032-e87968ea6850-kube-api-access-lhw6d\") pod \"volume-data-source-validator-78cf4c6f6-smx9m\" (UID: \"7e6961fd-69bc-4e1c-9032-e87968ea6850\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" Jul 20 16:14:18.829019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-installation-pull-secrets\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.829230 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff66143e-68d5-4d85-b36e-ece5c16b0583-config\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.829230 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7b7t\" (UniqueName: \"kubernetes.io/projected/ff66143e-68d5-4d85-b36e-ece5c16b0583-kube-api-access-x7b7t\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.829230 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn4kl\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-kube-api-access-jn4kl\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.829230 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-bound-sa-token\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.829365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1aec7cc-440a-4986-b862-53bd2868753b-ca-trust-extracted\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.829365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.829268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec4be2c5-4708-4c5f-aa26-93a0c4385983-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.836835 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.836817 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5lnsb"] Jul 20 16:14:18.836962 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.836939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:18.839585 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.839552 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 16:14:18.839724 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.839698 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.839784 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.839743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h2x74\"" Jul 20 16:14:18.840184 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.840023 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 16:14:18.840184 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.840035 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 16:14:18.840184 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.840086 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 16:14:18.840354 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.840214 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.840749 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.840722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:18.857884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.857834 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj"] Jul 20 16:14:18.857971 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.857914 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:18.860723 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.860669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 16:14:18.860723 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.860697 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fl6f5\"" Jul 20 16:14:18.860723 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.860697 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.860925 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.860719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.860925 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.860802 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 16:14:18.866045 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.866028 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 16:14:18.882083 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.882062 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7xdvh"] Jul 20 16:14:18.882188 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.882160 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" Jul 20 16:14:18.884839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.884820 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.884937 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.884875 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.884937 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.884824 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v9ppk\"" Jul 20 16:14:18.906189 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.906171 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xp4t9"] Jul 20 16:14:18.906303 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.906289 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:18.908856 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.908795 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tgrd\"" Jul 20 16:14:18.908856 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.908811 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 16:14:18.908996 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.908815 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 16:14:18.922344 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922326 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b"] Jul 20 16:14:18.922417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922352 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt"] Jul 20 16:14:18.922417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922364 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9dd64b47-x7pq8"] Jul 20 16:14:18.922417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922377 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5lnsb"] Jul 20 16:14:18.922417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922393 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5689bf4d-xfpk9"] Jul 20 16:14:18.922417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922408 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xp4t9"] Jul 20 16:14:18.922595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx"] Jul 20 16:14:18.922595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922441 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-h9z4k"] Jul 20 16:14:18.922595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922461 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7xdvh"] Jul 20 16:14:18.922595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj"] Jul 20 16:14:18.922595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.922520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:18.925214 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.925184 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 16:14:18.925319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.925255 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 16:14:18.925319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.925256 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sqlzb\"" Jul 20 16:14:18.925515 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.925491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 16:14:18.929658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-registry-certificates\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.929755 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-image-registry-private-configuration\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.929755 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.929755 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vmcv\" (UniqueName: \"kubernetes.io/projected/ec4be2c5-4708-4c5f-aa26-93a0c4385983-kube-api-access-5vmcv\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.929755 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-trusted-ca\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d231d19-8c91-4909-a694-274ab60dc28b-trusted-ca\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff66143e-68d5-4d85-b36e-ece5c16b0583-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:18.929868 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:18.929887 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9dd64b47-x7pq8: secret "image-registry-tls" not found Jul 20 16:14:18.929955 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:18.929937 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls podName:c1aec7cc-440a-4986-b862-53bd2868753b nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.42991808 +0000 UTC m=+36.586735349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls") pod "image-registry-c9dd64b47-x7pq8" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b") : secret "image-registry-tls" not found Jul 20 16:14:18.930256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.929870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptq5\" (UniqueName: \"kubernetes.io/projected/d11d1dbb-8796-45d2-a8e5-c4063501cd04-kube-api-access-tptq5\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:18.930256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f25s\" (UniqueName: \"kubernetes.io/projected/e37391c1-0eea-4704-8d79-1d3e46744d9a-kube-api-access-4f25s\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:18.930256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-registry-certificates\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.930256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv2r2\" (UniqueName: \"kubernetes.io/projected/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-kube-api-access-tv2r2\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:18.930256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1aec7cc-440a-4986-b862-53bd2868753b-ca-trust-extracted\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d11d1dbb-8796-45d2-a8e5-c4063501cd04-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbxvr\" (UniqueName: \"kubernetes.io/projected/0d231d19-8c91-4909-a694-274ab60dc28b-kube-api-access-tbxvr\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-stats-auth\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8d6a407-ff59-40fd-8663-058831636b28-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-installation-pull-secrets\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.930489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4be2c5-4708-4c5f-aa26-93a0c4385983-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.930884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-trusted-ca\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.930884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1aec7cc-440a-4986-b862-53bd2868753b-ca-trust-extracted\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.930884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d231d19-8c91-4909-a694-274ab60dc28b-serving-cert\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:18.930884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhw6d\" (UniqueName: \"kubernetes.io/projected/7e6961fd-69bc-4e1c-9032-e87968ea6850-kube-api-access-lhw6d\") pod \"volume-data-source-validator-78cf4c6f6-smx9m\" (UID: \"7e6961fd-69bc-4e1c-9032-e87968ea6850\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" Jul 20 16:14:18.930884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d231d19-8c91-4909-a694-274ab60dc28b-config\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:18.931135 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.930983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff66143e-68d5-4d85-b36e-ece5c16b0583-config\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.931135 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7b7t\" (UniqueName: \"kubernetes.io/projected/ff66143e-68d5-4d85-b36e-ece5c16b0583-kube-api-access-x7b7t\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.931135 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn4kl\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-kube-api-access-jn4kl\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.931470 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-bound-sa-token\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.931663 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:18.931743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-default-certificate\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:18.931743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec4be2c5-4708-4c5f-aa26-93a0c4385983-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.931851 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.931816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff66143e-68d5-4d85-b36e-ece5c16b0583-config\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.932324 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.932221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec4be2c5-4708-4c5f-aa26-93a0c4385983-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.933204 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.933180 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:18.934555 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.934532 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec4be2c5-4708-4c5f-aa26-93a0c4385983-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.934658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.934597 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-installation-pull-secrets\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.934658 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.934637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff66143e-68d5-4d85-b36e-ece5c16b0583-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.934738 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.934688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-image-registry-private-configuration\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.943171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.943141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vmcv\" (UniqueName: \"kubernetes.io/projected/ec4be2c5-4708-4c5f-aa26-93a0c4385983-kube-api-access-5vmcv\") pod \"kube-storage-version-migrator-operator-7658d9b749-574jz\" (UID: \"ec4be2c5-4708-4c5f-aa26-93a0c4385983\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:18.943882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.943858 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7b7t\" (UniqueName: \"kubernetes.io/projected/ff66143e-68d5-4d85-b36e-ece5c16b0583-kube-api-access-x7b7t\") pod \"service-ca-operator-5bcbc94c78-pwg6b\" (UID: \"ff66143e-68d5-4d85-b36e-ece5c16b0583\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:18.944106 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.944088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn4kl\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-kube-api-access-jn4kl\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.944158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.944106 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhw6d\" (UniqueName: \"kubernetes.io/projected/7e6961fd-69bc-4e1c-9032-e87968ea6850-kube-api-access-lhw6d\") pod \"volume-data-source-validator-78cf4c6f6-smx9m\" (UID: \"7e6961fd-69bc-4e1c-9032-e87968ea6850\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" Jul 20 16:14:18.944217 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.944200 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-bound-sa-token\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:18.999277 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:18.999255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" Jul 20 16:14:19.031893 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.031854 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" Jul 20 16:14:19.032036 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.032191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d11d1dbb-8796-45d2-a8e5-c4063501cd04-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:19.032191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbxvr\" (UniqueName: \"kubernetes.io/projected/0d231d19-8c91-4909-a694-274ab60dc28b-kube-api-access-tbxvr\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.032191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.032191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032144 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-stats-auth\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.032191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8d6a407-ff59-40fd-8663-058831636b28-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.032199 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.532178254 +0000 UTC m=+36.688995537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : configmap references non-existent config key: service-ca.crt Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8d011e9-8d9b-4585-bad2-052fcbcd3412-tmp\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af51abb7-967c-4c28-8d7f-bf7404e64c29-cert\") pod \"ingress-canary-xp4t9\" (UID: \"af51abb7-967c-4c28-8d7f-bf7404e64c29\") " pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032291 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d231d19-8c91-4909-a694-274ab60dc28b-serving-cert\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032318 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d231d19-8c91-4909-a694-274ab60dc28b-config\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:19.032458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1051119f-7bbc-4c90-bf2c-e558d052aae7-config-volume\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.032822 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.032497 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:19.032822 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1051119f-7bbc-4c90-bf2c-e558d052aae7-tmp-dir\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.032822 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.032567 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:14:19.032822 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.032703 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.532660237 +0000 UTC m=+36.689477503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : secret "router-metrics-certs-default" not found Jul 20 16:14:19.032822 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-default-certificate\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.032822 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8d6a407-ff59-40fd-8663-058831636b28-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:19.033121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntpfs\" (UniqueName: \"kubernetes.io/projected/b718e781-b5eb-41b4-8779-863fd394f7a8-kube-api-access-ntpfs\") pod \"network-check-source-7bc5b6bf85-k84gj\" (UID: \"b718e781-b5eb-41b4-8779-863fd394f7a8\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" Jul 20 16:14:19.033121 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.032893 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls podName:d11d1dbb-8796-45d2-a8e5-c4063501cd04 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.532875383 +0000 UTC m=+36.689692668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qnskx" (UID: "d11d1dbb-8796-45d2-a8e5-c4063501cd04") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:19.033121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.032918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d011e9-8d9b-4585-bad2-052fcbcd3412-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.033121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c8d011e9-8d9b-4585-bad2-052fcbcd3412-snapshots\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.033121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d011e9-8d9b-4585-bad2-052fcbcd3412-service-ca-bundle\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc5ld\" (UniqueName: \"kubernetes.io/projected/1051119f-7bbc-4c90-bf2c-e558d052aae7-kube-api-access-wc5ld\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033203 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d11d1dbb-8796-45d2-a8e5-c4063501cd04-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d231d19-8c91-4909-a694-274ab60dc28b-trusted-ca\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdzhb\" (UniqueName: \"kubernetes.io/projected/c8d011e9-8d9b-4585-bad2-052fcbcd3412-kube-api-access-cdzhb\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d231d19-8c91-4909-a694-274ab60dc28b-config\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.033320 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:14:19.033365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.033321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.033872 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.033384 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.034591 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert podName:d8d6a407-ff59-40fd-8663-058831636b28 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.533362186 +0000 UTC m=+36.690179451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jfddt" (UID: "d8d6a407-ff59-40fd-8663-058831636b28") : secret "networking-console-plugin-cert" not found Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.034644 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls podName:e37391c1-0eea-4704-8d79-1d3e46744d9a nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.534613314 +0000 UTC m=+36.691430596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p66mz" (UID: "e37391c1-0eea-4704-8d79-1d3e46744d9a") : secret "samples-operator-tls" not found Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.034701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptq5\" (UniqueName: \"kubernetes.io/projected/d11d1dbb-8796-45d2-a8e5-c4063501cd04-kube-api-access-tptq5\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.034746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d011e9-8d9b-4585-bad2-052fcbcd3412-serving-cert\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.034798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z525\" (UniqueName: \"kubernetes.io/projected/af51abb7-967c-4c28-8d7f-bf7404e64c29-kube-api-access-5z525\") pod \"ingress-canary-xp4t9\" (UID: \"af51abb7-967c-4c28-8d7f-bf7404e64c29\") " pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.034856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f25s\" (UniqueName: \"kubernetes.io/projected/e37391c1-0eea-4704-8d79-1d3e46744d9a-kube-api-access-4f25s\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.034901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2r2\" (UniqueName: \"kubernetes.io/projected/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-kube-api-access-tv2r2\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.036307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.035913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-stats-auth\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.036742 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.036578 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d231d19-8c91-4909-a694-274ab60dc28b-serving-cert\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.040997 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.037093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-default-certificate\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.042564 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.042537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbxvr\" (UniqueName: \"kubernetes.io/projected/0d231d19-8c91-4909-a694-274ab60dc28b-kube-api-access-tbxvr\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.044324 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.044300 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv2r2\" (UniqueName: \"kubernetes.io/projected/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-kube-api-access-tv2r2\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.044565 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.044544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f25s\" (UniqueName: \"kubernetes.io/projected/e37391c1-0eea-4704-8d79-1d3e46744d9a-kube-api-access-4f25s\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:19.045069 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.045050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptq5\" (UniqueName: \"kubernetes.io/projected/d11d1dbb-8796-45d2-a8e5-c4063501cd04-kube-api-access-tptq5\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:19.046505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.046486 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d231d19-8c91-4909-a694-274ab60dc28b-trusted-ca\") pod \"console-operator-565b7b569d-h9z4k\" (UID: \"0d231d19-8c91-4909-a694-274ab60dc28b\") " pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.048826 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.048781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" Jul 20 16:14:19.108482 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.108400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:19.141093 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.140969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c8d011e9-8d9b-4585-bad2-052fcbcd3412-snapshots\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.141093 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d011e9-8d9b-4585-bad2-052fcbcd3412-service-ca-bundle\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.141093 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc5ld\" (UniqueName: \"kubernetes.io/projected/1051119f-7bbc-4c90-bf2c-e558d052aae7-kube-api-access-wc5ld\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.141329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdzhb\" (UniqueName: \"kubernetes.io/projected/c8d011e9-8d9b-4585-bad2-052fcbcd3412-kube-api-access-cdzhb\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.141329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.141329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d011e9-8d9b-4585-bad2-052fcbcd3412-serving-cert\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.141329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141204 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z525\" (UniqueName: \"kubernetes.io/projected/af51abb7-967c-4c28-8d7f-bf7404e64c29-kube-api-access-5z525\") pod \"ingress-canary-xp4t9\" (UID: \"af51abb7-967c-4c28-8d7f-bf7404e64c29\") " pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.141329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8d011e9-8d9b-4585-bad2-052fcbcd3412-tmp\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.141329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af51abb7-967c-4c28-8d7f-bf7404e64c29-cert\") pod \"ingress-canary-xp4t9\" (UID: \"af51abb7-967c-4c28-8d7f-bf7404e64c29\") " pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.141596 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1051119f-7bbc-4c90-bf2c-e558d052aae7-config-volume\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.141596 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1051119f-7bbc-4c90-bf2c-e558d052aae7-tmp-dir\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.141596 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntpfs\" (UniqueName: \"kubernetes.io/projected/b718e781-b5eb-41b4-8779-863fd394f7a8-kube-api-access-ntpfs\") pod \"network-check-source-7bc5b6bf85-k84gj\" (UID: \"b718e781-b5eb-41b4-8779-863fd394f7a8\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" Jul 20 16:14:19.141596 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.141461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d011e9-8d9b-4585-bad2-052fcbcd3412-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.142495 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.142467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d011e9-8d9b-4585-bad2-052fcbcd3412-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.143020 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.142999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c8d011e9-8d9b-4585-bad2-052fcbcd3412-snapshots\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.143434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.143413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d011e9-8d9b-4585-bad2-052fcbcd3412-service-ca-bundle\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.143952 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.143872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8d011e9-8d9b-4585-bad2-052fcbcd3412-tmp\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.146505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.144428 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:14:19.146505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.144497 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls podName:1051119f-7bbc-4c90-bf2c-e558d052aae7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:19.644476868 +0000 UTC m=+36.801294147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls") pod "dns-default-7xdvh" (UID: "1051119f-7bbc-4c90-bf2c-e558d052aae7") : secret "dns-default-metrics-tls" not found Jul 20 16:14:19.146505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.145700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1051119f-7bbc-4c90-bf2c-e558d052aae7-config-volume\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.146505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.146258 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1051119f-7bbc-4c90-bf2c-e558d052aae7-tmp-dir\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.151651 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.151365 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d011e9-8d9b-4585-bad2-052fcbcd3412-serving-cert\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.167645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.165233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc5ld\" (UniqueName: \"kubernetes.io/projected/1051119f-7bbc-4c90-bf2c-e558d052aae7-kube-api-access-wc5ld\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.167645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.165479 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdzhb\" (UniqueName: \"kubernetes.io/projected/c8d011e9-8d9b-4585-bad2-052fcbcd3412-kube-api-access-cdzhb\") pod \"insights-operator-555d9d7885-5lnsb\" (UID: \"c8d011e9-8d9b-4585-bad2-052fcbcd3412\") " pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.167645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.166169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z525\" (UniqueName: \"kubernetes.io/projected/af51abb7-967c-4c28-8d7f-bf7404e64c29-kube-api-access-5z525\") pod \"ingress-canary-xp4t9\" (UID: \"af51abb7-967c-4c28-8d7f-bf7404e64c29\") " pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.167645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.166641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af51abb7-967c-4c28-8d7f-bf7404e64c29-cert\") pod \"ingress-canary-xp4t9\" (UID: \"af51abb7-967c-4c28-8d7f-bf7404e64c29\") " pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.167645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.166777 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" Jul 20 16:14:19.169449 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.169384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntpfs\" (UniqueName: \"kubernetes.io/projected/b718e781-b5eb-41b4-8779-863fd394f7a8-kube-api-access-ntpfs\") pod \"network-check-source-7bc5b6bf85-k84gj\" (UID: \"b718e781-b5eb-41b4-8779-863fd394f7a8\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" Jul 20 16:14:19.191505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.191376 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" Jul 20 16:14:19.234086 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.233850 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xp4t9" Jul 20 16:14:19.253818 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.253784 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz"] Jul 20 16:14:19.268349 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.268220 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m"] Jul 20 16:14:19.271298 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:19.271233 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6961fd_69bc_4e1c_9032_e87968ea6850.slice/crio-7312bf8480d294eda1676893c1b1ffdb5d2728d3a046cd3c9cd34179c3fa1a14 WatchSource:0}: Error finding container 7312bf8480d294eda1676893c1b1ffdb5d2728d3a046cd3c9cd34179c3fa1a14: Status 404 returned error can't find the container with id 7312bf8480d294eda1676893c1b1ffdb5d2728d3a046cd3c9cd34179c3fa1a14 Jul 20 16:14:19.295143 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.295077 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b"] Jul 20 16:14:19.355716 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.355508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-h9z4k"] Jul 20 16:14:19.381399 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.381312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5lnsb"] Jul 20 16:14:19.384203 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.384144 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj"] Jul 20 16:14:19.385987 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:19.385953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d011e9_8d9b_4585_bad2_052fcbcd3412.slice/crio-12195e7825776833b91827a8130bae6d14d488e7f06efc2d6506f6033b0636c6 WatchSource:0}: Error finding container 12195e7825776833b91827a8130bae6d14d488e7f06efc2d6506f6033b0636c6: Status 404 returned error can't find the container with id 12195e7825776833b91827a8130bae6d14d488e7f06efc2d6506f6033b0636c6 Jul 20 16:14:19.387462 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.387432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:19.390841 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:19.390815 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb718e781_b5eb_41b4_8779_863fd394f7a8.slice/crio-524b8aadc699bd8dadd4201d6fc11e9ec5eafafd507b5f3efc83772e80f7628f WatchSource:0}: Error finding container 524b8aadc699bd8dadd4201d6fc11e9ec5eafafd507b5f3efc83772e80f7628f: Status 404 returned error can't find the container with id 524b8aadc699bd8dadd4201d6fc11e9ec5eafafd507b5f3efc83772e80f7628f Jul 20 16:14:19.426769 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.426746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xp4t9"] Jul 20 16:14:19.429055 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:19.429025 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf51abb7_967c_4c28_8d7f_bf7404e64c29.slice/crio-34defc9bf44f3b333dd695db5d77f6d3c4aa4a61a1576f1dce9601ae9826e7d9 WatchSource:0}: Error finding container 34defc9bf44f3b333dd695db5d77f6d3c4aa4a61a1576f1dce9601ae9826e7d9: Status 404 returned error can't find the container with id 34defc9bf44f3b333dd695db5d77f6d3c4aa4a61a1576f1dce9601ae9826e7d9 Jul 20 16:14:19.446005 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.445983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:19.446161 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.446135 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:14:19.446161 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.446156 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9dd64b47-x7pq8: secret "image-registry-tls" not found Jul 20 16:14:19.446273 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.446214 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls podName:c1aec7cc-440a-4986-b862-53bd2868753b nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.446195194 +0000 UTC m=+37.603012462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls") pod "image-registry-c9dd64b47-x7pq8" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b") : secret "image-registry-tls" not found Jul 20 16:14:19.483396 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.483368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:19.546861 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.546836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.546982 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.546918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:19.547043 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.546988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:19.547043 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547011 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:14:19.547043 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.547018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:19.547182 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547051 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:19.547182 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.547089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:19.547182 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547108 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls podName:d11d1dbb-8796-45d2-a8e5-c4063501cd04 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.54708759 +0000 UTC m=+37.703904874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qnskx" (UID: "d11d1dbb-8796-45d2-a8e5-c4063501cd04") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:19.547182 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547128 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:14:19.547182 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547155 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:14:19.547182 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547157 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.547147169 +0000 UTC m=+37.703964437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : secret "router-metrics-certs-default" not found Jul 20 16:14:19.547549 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547208 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.547192468 +0000 UTC m=+37.704009749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : configmap references non-existent config key: service-ca.crt Jul 20 16:14:19.547549 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547218 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert podName:d8d6a407-ff59-40fd-8663-058831636b28 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.54721281 +0000 UTC m=+37.704030074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jfddt" (UID: "d8d6a407-ff59-40fd-8663-058831636b28") : secret "networking-console-plugin-cert" not found Jul 20 16:14:19.547549 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.547231 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls podName:e37391c1-0eea-4704-8d79-1d3e46744d9a nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.547223584 +0000 UTC m=+37.704040849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p66mz" (UID: "e37391c1-0eea-4704-8d79-1d3e46744d9a") : secret "samples-operator-tls" not found Jul 20 16:14:19.647900 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.647837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:19.648483 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.647974 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:14:19.648483 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:19.648025 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls podName:1051119f-7bbc-4c90-bf2c-e558d052aae7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:20.648012276 +0000 UTC m=+37.804829541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls") pod "dns-default-7xdvh" (UID: "1051119f-7bbc-4c90-bf2c-e558d052aae7") : secret "dns-default-metrics-tls" not found Jul 20 16:14:19.775279 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.775249 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" event={"ID":"ff66143e-68d5-4d85-b36e-ece5c16b0583","Type":"ContainerStarted","Data":"f45b509ee64e67d1430f32deac66e81756ded7adce283a6f367122f5804c29a7"} Jul 20 16:14:19.776384 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.776362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" event={"ID":"ec4be2c5-4708-4c5f-aa26-93a0c4385983","Type":"ContainerStarted","Data":"feccab47e1106d9df524f088285556a4062dbbcbf49721daa4fae99cec04b67c"} Jul 20 16:14:19.777499 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.777476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" event={"ID":"b718e781-b5eb-41b4-8779-863fd394f7a8","Type":"ContainerStarted","Data":"524b8aadc699bd8dadd4201d6fc11e9ec5eafafd507b5f3efc83772e80f7628f"} Jul 20 16:14:19.778411 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.778391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" event={"ID":"c8d011e9-8d9b-4585-bad2-052fcbcd3412","Type":"ContainerStarted","Data":"12195e7825776833b91827a8130bae6d14d488e7f06efc2d6506f6033b0636c6"} Jul 20 16:14:19.779343 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.779324 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" event={"ID":"7e6961fd-69bc-4e1c-9032-e87968ea6850","Type":"ContainerStarted","Data":"7312bf8480d294eda1676893c1b1ffdb5d2728d3a046cd3c9cd34179c3fa1a14"} Jul 20 16:14:19.780363 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.780347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xp4t9" event={"ID":"af51abb7-967c-4c28-8d7f-bf7404e64c29","Type":"ContainerStarted","Data":"34defc9bf44f3b333dd695db5d77f6d3c4aa4a61a1576f1dce9601ae9826e7d9"} Jul 20 16:14:19.781292 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:19.781270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" event={"ID":"0d231d19-8c91-4909-a694-274ab60dc28b","Type":"ContainerStarted","Data":"5ac27ae8c385019dcea72eed2d2aaf22e170ad0557d01889d31d31cac4ccf713"} Jul 20 16:14:20.455525 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.454911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:20.455525 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.455112 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:14:20.455525 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.455128 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9dd64b47-x7pq8: secret "image-registry-tls" not found Jul 20 16:14:20.455525 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.455183 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls podName:c1aec7cc-440a-4986-b862-53bd2868753b nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.455165255 +0000 UTC m=+39.611982524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls") pod "image-registry-c9dd64b47-x7pq8" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b") : secret "image-registry-tls" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.556125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.556183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.556254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.556285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.556343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556486 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556550 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls podName:d11d1dbb-8796-45d2-a8e5-c4063501cd04 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.55652982 +0000 UTC m=+39.713347111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qnskx" (UID: "d11d1dbb-8796-45d2-a8e5-c4063501cd04") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556614 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556670 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert podName:d8d6a407-ff59-40fd-8663-058831636b28 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.556658514 +0000 UTC m=+39.713475782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jfddt" (UID: "d8d6a407-ff59-40fd-8663-058831636b28") : secret "networking-console-plugin-cert" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556725 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556766 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls podName:e37391c1-0eea-4704-8d79-1d3e46744d9a nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.55674453 +0000 UTC m=+39.713561801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p66mz" (UID: "e37391c1-0eea-4704-8d79-1d3e46744d9a") : secret "samples-operator-tls" not found Jul 20 16:14:20.557255 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556834 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.556824367 +0000 UTC m=+39.713641633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : configmap references non-existent config key: service-ca.crt Jul 20 16:14:20.558112 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556889 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:14:20.558112 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.556918 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.556907921 +0000 UTC m=+39.713725190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : secret "router-metrics-certs-default" not found Jul 20 16:14:20.598139 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.596791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:20.598139 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.597238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:20.598139 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.597596 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:20.600889 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.600140 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sngxb\"" Jul 20 16:14:20.600889 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.600371 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:14:20.600889 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.600593 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:14:20.605131 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.603609 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fbfhg\"" Jul 20 16:14:20.657360 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:20.657331 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:20.657755 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.657475 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:14:20.657755 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:20.657531 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls podName:1051119f-7bbc-4c90-bf2c-e558d052aae7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:22.657513716 +0000 UTC m=+39.814330997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls") pod "dns-default-7xdvh" (UID: "1051119f-7bbc-4c90-bf2c-e558d052aae7") : secret "dns-default-metrics-tls" not found Jul 20 16:14:22.486252 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.486166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:22.486664 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.486324 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:14:22.486664 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.486344 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9dd64b47-x7pq8: secret "image-registry-tls" not found Jul 20 16:14:22.486664 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.486414 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls podName:c1aec7cc-440a-4986-b862-53bd2868753b nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.486395021 +0000 UTC m=+43.643212303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls") pod "image-registry-c9dd64b47-x7pq8" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b") : secret "image-registry-tls" not found Jul 20 16:14:22.587860 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.587801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:22.588035 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.587953 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:22.588035 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.587968 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.587945448 +0000 UTC m=+43.744762732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : configmap references non-existent config key: service-ca.crt Jul 20 16:14:22.588144 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588055 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:14:22.588144 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.588062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:22.588144 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588113 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.58810167 +0000 UTC m=+43.744918943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : secret "router-metrics-certs-default" not found Jul 20 16:14:22.588257 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588158 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:22.588257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.588192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:22.588257 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588203 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls podName:d11d1dbb-8796-45d2-a8e5-c4063501cd04 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.588186468 +0000 UTC m=+43.745003738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qnskx" (UID: "d11d1dbb-8796-45d2-a8e5-c4063501cd04") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:22.588257 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.588240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:22.588422 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588266 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:14:22.588422 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588302 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert podName:d8d6a407-ff59-40fd-8663-058831636b28 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.588291169 +0000 UTC m=+43.745108440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jfddt" (UID: "d8d6a407-ff59-40fd-8663-058831636b28") : secret "networking-console-plugin-cert" not found Jul 20 16:14:22.588422 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588348 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:14:22.588422 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.588384 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls podName:e37391c1-0eea-4704-8d79-1d3e46744d9a nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.588371968 +0000 UTC m=+43.745189233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p66mz" (UID: "e37391c1-0eea-4704-8d79-1d3e46744d9a") : secret "samples-operator-tls" not found Jul 20 16:14:22.689301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:22.689238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:22.689480 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.689380 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:14:22.689480 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:22.689438 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls podName:1051119f-7bbc-4c90-bf2c-e558d052aae7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:26.689420999 +0000 UTC m=+43.846238277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls") pod "dns-default-7xdvh" (UID: "1051119f-7bbc-4c90-bf2c-e558d052aae7") : secret "dns-default-metrics-tls" not found Jul 20 16:14:24.020318 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:24.020287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:24.117530 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:24.117498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:26.523161 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.523127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:26.523638 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.523336 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:14:26.523638 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.523360 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9dd64b47-x7pq8: secret "image-registry-tls" not found Jul 20 16:14:26.523638 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.523426 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls podName:c1aec7cc-440a-4986-b862-53bd2868753b nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.52341119 +0000 UTC m=+51.680228455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls") pod "image-registry-c9dd64b47-x7pq8" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b") : secret "image-registry-tls" not found Jul 20 16:14:26.624503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.624463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:26.624735 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.624510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:26.624735 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.624566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:26.624735 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.624631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:26.624735 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.624702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:26.624735 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624710 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624710 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624716 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624783 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.624761021 +0000 UTC m=+51.781578291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : configmap references non-existent config key: service-ca.crt Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624805 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls podName:e37391c1-0eea-4704-8d79-1d3e46744d9a nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.624793439 +0000 UTC m=+51.781610722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p66mz" (UID: "e37391c1-0eea-4704-8d79-1d3e46744d9a") : secret "samples-operator-tls" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624822 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.62481249 +0000 UTC m=+51.781629756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : secret "router-metrics-certs-default" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624837 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert podName:d8d6a407-ff59-40fd-8663-058831636b28 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.624831865 +0000 UTC m=+51.781649130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jfddt" (UID: "d8d6a407-ff59-40fd-8663-058831636b28") : secret "networking-console-plugin-cert" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624873 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:26.624994 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.624926 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls podName:d11d1dbb-8796-45d2-a8e5-c4063501cd04 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.624911259 +0000 UTC m=+51.781728525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qnskx" (UID: "d11d1dbb-8796-45d2-a8e5-c4063501cd04") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:26.725768 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:26.725718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:26.725932 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.725862 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:14:26.725932 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:26.725924 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls podName:1051119f-7bbc-4c90-bf2c-e558d052aae7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:34.725908431 +0000 UTC m=+51.882725696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls") pod "dns-default-7xdvh" (UID: "1051119f-7bbc-4c90-bf2c-e558d052aae7") : secret "dns-default-metrics-tls" not found Jul 20 16:14:27.091330 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:27.091293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:27.191035 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:27.191001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:28.120980 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:28.120946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:29.143763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.143728 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:29.196366 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.196306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:29.827175 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.826772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" event={"ID":"b718e781-b5eb-41b4-8779-863fd394f7a8","Type":"ContainerStarted","Data":"6fcdb2334e73aed82f2f190184dde8afc74bb99ea86d50b4b219247c719caa5a"} Jul 20 16:14:29.829438 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.829091 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" event={"ID":"c8d011e9-8d9b-4585-bad2-052fcbcd3412","Type":"ContainerStarted","Data":"a3cb38996af17d233abec1503a3bfbd45039c48103fdebaa8df974f39edf2010"} Jul 20 16:14:29.839096 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.838595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" event={"ID":"7e6961fd-69bc-4e1c-9032-e87968ea6850","Type":"ContainerStarted","Data":"7cd3a0139df937da10e16b0712aef3cadaf8c062df4a2a1f44ee35e61b000c83"} Jul 20 16:14:29.841711 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.841282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xp4t9" event={"ID":"af51abb7-967c-4c28-8d7f-bf7404e64c29","Type":"ContainerStarted","Data":"69dd64127242e15c1f15df84df6573bef8ce674b5e6a83c71cc168c66c315628"} Jul 20 16:14:29.845355 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.845334 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerStarted","Data":"9d656e2e9cb9261e20dd07d97bfd27a052e3b5e54b527bf7eac190d7f5da6f58"} Jul 20 16:14:29.847695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.847658 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/0.log" Jul 20 16:14:29.847800 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.847697 2575 generic.go:356] "Generic (PLEG): container finished" podID="0d231d19-8c91-4909-a694-274ab60dc28b" containerID="6cc246dfbde01800ef76689ec291c445e23dcae99862a7e38e0c1af186fb9eda" exitCode=255 Jul 20 16:14:29.848196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.847917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" event={"ID":"0d231d19-8c91-4909-a694-274ab60dc28b","Type":"ContainerDied","Data":"6cc246dfbde01800ef76689ec291c445e23dcae99862a7e38e0c1af186fb9eda"} Jul 20 16:14:29.848196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.848054 2575 scope.go:117] "RemoveContainer" containerID="6cc246dfbde01800ef76689ec291c445e23dcae99862a7e38e0c1af186fb9eda" Jul 20 16:14:29.852256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.852184 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" podStartSLOduration=9.751672472 podStartE2EDuration="19.852169075s" totalImagesPullingTime="10.100496603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.851759356 +0000 UTC m=+47.008576644" watchObservedRunningTime="2026-07-20 16:14:29.852169075 +0000 UTC m=+47.008986364" Jul 20 16:14:29.858567 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.855804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" event={"ID":"ff66143e-68d5-4d85-b36e-ece5c16b0583","Type":"ContainerStarted","Data":"faa2996864eca1d7e0ba7f38be0a3feff261283e897c9ede3cad67a50dacbf95"} Jul 20 16:14:29.858567 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.858180 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" event={"ID":"ec4be2c5-4708-4c5f-aa26-93a0c4385983","Type":"ContainerStarted","Data":"998525c3279185c06d539e9e6f312e7c9ce472593541b38a074b0a9ad5209e31"} Jul 20 16:14:29.916539 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.916475 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-smx9m" podStartSLOduration=11.261783661 podStartE2EDuration="20.916455711s" totalImagesPullingTime="9.65467205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.915084463 +0000 UTC m=+47.071901751" watchObservedRunningTime="2026-07-20 16:14:29.916455711 +0000 UTC m=+47.073272996" Jul 20 16:14:29.957172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.957120 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xp4t9" podStartSLOduration=1.897846483 podStartE2EDuration="11.957100626s" totalImagesPullingTime="10.059254143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.935966618 +0000 UTC m=+47.092783906" watchObservedRunningTime="2026-07-20 16:14:29.957100626 +0000 UTC m=+47.113917914" Jul 20 16:14:29.958568 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.957891 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" podStartSLOduration=10.772092428 podStartE2EDuration="20.957879465s" totalImagesPullingTime="10.185787037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.957520888 +0000 UTC m=+47.114338176" watchObservedRunningTime="2026-07-20 16:14:29.957879465 +0000 UTC m=+47.114696752" Jul 20 16:14:29.977784 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:29.976545 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" podStartSLOduration=10.748082997000001 podStartE2EDuration="20.976529102s" totalImagesPullingTime="10.228446105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:29.976261576 +0000 UTC m=+47.133078863" watchObservedRunningTime="2026-07-20 16:14:29.976529102 +0000 UTC m=+47.133346390" Jul 20 16:14:30.001653 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.001593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:30.101145 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.101112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:30.863880 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.863746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:30.864844 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.864817 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c22a50f-4bc8-49ad-b79a-b3801170e739" containerID="9d656e2e9cb9261e20dd07d97bfd27a052e3b5e54b527bf7eac190d7f5da6f58" exitCode=0 Jul 20 16:14:30.864974 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.864906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerDied","Data":"9d656e2e9cb9261e20dd07d97bfd27a052e3b5e54b527bf7eac190d7f5da6f58"} Jul 20 16:14:30.867082 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.867062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:14:30.867540 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.867516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/0.log" Jul 20 16:14:30.867649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.867555 2575 generic.go:356] "Generic (PLEG): container finished" podID="0d231d19-8c91-4909-a694-274ab60dc28b" containerID="4c68450124c853990fbb7f4e92eacbd68af59b7c46cefe4cf9ce0b4e3f3803c9" exitCode=255 Jul 20 16:14:30.867723 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.867667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" event={"ID":"0d231d19-8c91-4909-a694-274ab60dc28b","Type":"ContainerDied","Data":"4c68450124c853990fbb7f4e92eacbd68af59b7c46cefe4cf9ce0b4e3f3803c9"} Jul 20 16:14:30.867723 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.867711 2575 scope.go:117] "RemoveContainer" containerID="6cc246dfbde01800ef76689ec291c445e23dcae99862a7e38e0c1af186fb9eda" Jul 20 16:14:30.868205 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.867918 2575 scope.go:117] "RemoveContainer" containerID="4c68450124c853990fbb7f4e92eacbd68af59b7c46cefe4cf9ce0b4e3f3803c9" Jul 20 16:14:30.868205 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:30.868082 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-h9z4k_openshift-console-operator(0d231d19-8c91-4909-a694-274ab60dc28b)\"" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" podUID="0d231d19-8c91-4909-a694-274ab60dc28b" Jul 20 16:14:30.920644 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.920456 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-k84gj" podStartSLOduration=11.813039417 podStartE2EDuration="21.920438572s" totalImagesPullingTime="10.107399155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:30.903695847 +0000 UTC m=+48.060513135" watchObservedRunningTime="2026-07-20 16:14:30.920438572 +0000 UTC m=+48.077255859" Jul 20 16:14:30.986541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:30.986513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:31.304023 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.303990 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn"] Jul 20 16:14:31.307328 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.307293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:31.326839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.326807 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn"] Jul 20 16:14:31.326986 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.326918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" Jul 20 16:14:31.329406 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.329380 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:31.329694 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.329674 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 16:14:31.329694 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.329688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ht26z\"" Jul 20 16:14:31.334362 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.334335 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2kmgp"] Jul 20 16:14:31.356839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.356812 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2kmgp"] Jul 20 16:14:31.356995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.356949 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.359527 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.359506 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 16:14:31.359664 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.359545 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 16:14:31.359664 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.359555 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzr47\"" Jul 20 16:14:31.366889 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.366868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4md9\" (UniqueName: \"kubernetes.io/projected/4473d8c9-9dcd-4729-8447-ab9c09fe6bfd-kube-api-access-n4md9\") pod \"migrator-7cc9c7ffd7-t4wsn\" (UID: \"4473d8c9-9dcd-4729-8447-ab9c09fe6bfd\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" Jul 20 16:14:31.377455 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.377430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:31.439551 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.439520 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:31.467893 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.467865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.468003 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.467897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfnf\" (UniqueName: \"kubernetes.io/projected/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-api-access-4dfnf\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.468003 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.467985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.468116 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.468070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e0bf1c6-7976-46f1-b26a-057b07e287b7-data-volume\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.468116 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.468099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e0bf1c6-7976-46f1-b26a-057b07e287b7-crio-socket\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.468220 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.468184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4md9\" (UniqueName: \"kubernetes.io/projected/4473d8c9-9dcd-4729-8447-ab9c09fe6bfd-kube-api-access-n4md9\") pod \"migrator-7cc9c7ffd7-t4wsn\" (UID: \"4473d8c9-9dcd-4729-8447-ab9c09fe6bfd\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" Jul 20 16:14:31.477736 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.477714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4md9\" (UniqueName: \"kubernetes.io/projected/4473d8c9-9dcd-4729-8447-ab9c09fe6bfd-kube-api-access-n4md9\") pod \"migrator-7cc9c7ffd7-t4wsn\" (UID: \"4473d8c9-9dcd-4729-8447-ab9c09fe6bfd\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" Jul 20 16:14:31.568929 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.568865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.568929 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.568897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfnf\" (UniqueName: \"kubernetes.io/projected/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-api-access-4dfnf\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.569101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.568947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.569101 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:31.568999 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:14:31.569101 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:31.569070 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:32.069049426 +0000 UTC m=+49.225866696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : configmap "kube-rbac-proxy" not found Jul 20 16:14:31.569101 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:31.569085 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:14:31.569272 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.569006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e0bf1c6-7976-46f1-b26a-057b07e287b7-data-volume\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.569272 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:31.569137 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:32.069121831 +0000 UTC m=+49.225939115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : secret "insights-runtime-extractor-tls" not found Jul 20 16:14:31.569272 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.569155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e0bf1c6-7976-46f1-b26a-057b07e287b7-crio-socket\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.569365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.569289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e0bf1c6-7976-46f1-b26a-057b07e287b7-data-volume\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.569365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.569353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e0bf1c6-7976-46f1-b26a-057b07e287b7-crio-socket\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.577240 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.577217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfnf\" (UniqueName: \"kubernetes.io/projected/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-api-access-4dfnf\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:31.639095 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.639073 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" Jul 20 16:14:31.653291 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.653263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:31.754229 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.754197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:31.779222 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.779201 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn"] Jul 20 16:14:31.781268 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:31.781246 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4473d8c9_9dcd_4729_8447_ab9c09fe6bfd.slice/crio-47d797ddcc88af833151b7c57b6c60fbc468c36a606b4e1c9d48ea9b73322c3b WatchSource:0}: Error finding container 47d797ddcc88af833151b7c57b6c60fbc468c36a606b4e1c9d48ea9b73322c3b: Status 404 returned error can't find the container with id 47d797ddcc88af833151b7c57b6c60fbc468c36a606b4e1c9d48ea9b73322c3b Jul 20 16:14:31.874556 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.874501 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c22a50f-4bc8-49ad-b79a-b3801170e739" containerID="50f285e2005d844c97a1a90a3bf4fa94a7e7977caef5ae3f4d2f472eb5a4def5" exitCode=0 Jul 20 16:14:31.874881 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.874577 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerDied","Data":"50f285e2005d844c97a1a90a3bf4fa94a7e7977caef5ae3f4d2f472eb5a4def5"} Jul 20 16:14:31.876073 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.876057 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:14:31.876416 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.876399 2575 scope.go:117] "RemoveContainer" containerID="4c68450124c853990fbb7f4e92eacbd68af59b7c46cefe4cf9ce0b4e3f3803c9" Jul 20 16:14:31.876584 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:31.876564 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-h9z4k_openshift-console-operator(0d231d19-8c91-4909-a694-274ab60dc28b)\"" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" podUID="0d231d19-8c91-4909-a694-274ab60dc28b" Jul 20 16:14:31.877228 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:31.877204 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" event={"ID":"4473d8c9-9dcd-4729-8447-ab9c09fe6bfd","Type":"ContainerStarted","Data":"47d797ddcc88af833151b7c57b6c60fbc468c36a606b4e1c9d48ea9b73322c3b"} Jul 20 16:14:32.073193 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:32.073156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:32.073317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:32.073215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:32.073317 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:32.073271 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:14:32.073400 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:32.073334 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:33.073320491 +0000 UTC m=+50.230137759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : configmap "kube-rbac-proxy" not found Jul 20 16:14:32.073400 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:32.073332 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:14:32.073400 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:32.073363 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:33.073356586 +0000 UTC m=+50.230173852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : secret "insights-runtime-extractor-tls" not found Jul 20 16:14:32.073998 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:32.073974 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:32.882981 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:32.882934 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" event={"ID":"2c22a50f-4bc8-49ad-b79a-b3801170e739","Type":"ContainerStarted","Data":"70856dd554456d289560a585197348f1b3b23de5af745f5767e4f8f46b3b23f6"} Jul 20 16:14:32.906587 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:32.906543 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g6mkn" podStartSLOduration=8.887749786 podStartE2EDuration="49.906528682s" totalImagesPullingTime="41.018778896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:32.904749805 +0000 UTC m=+50.061567089" watchObservedRunningTime="2026-07-20 16:14:32.906528682 +0000 UTC m=+50.063345969" Jul 20 16:14:33.025656 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.025603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:33.082857 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.082826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:33.083038 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:33.082955 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 16:14:33.083038 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.082989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:33.083038 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:33.083024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:35.083003712 +0000 UTC m=+52.239820977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : configmap "kube-rbac-proxy" not found Jul 20 16:14:33.083210 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:33.083083 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:14:33.083210 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:33.083135 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:35.083118314 +0000 UTC m=+52.239935599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : secret "insights-runtime-extractor-tls" not found Jul 20 16:14:33.092609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.092579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:33.150491 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.150433 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hl66h_a4ee803d-c3da-442d-8041-6185d4b45655/dns-node-resolver/0.log" Jul 20 16:14:33.168236 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.168204 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-kjgwp"] Jul 20 16:14:33.184916 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.184889 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-kjgwp"] Jul 20 16:14:33.185030 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.185014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.187839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.187681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 20 16:14:33.187839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.187701 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vpsgg\"" Jul 20 16:14:33.187839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.187688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 20 16:14:33.187839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.187747 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 20 16:14:33.188066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.187883 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 20 16:14:33.203825 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.203799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:33.257515 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.257494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:33.284497 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.284476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mkff\" (UniqueName: \"kubernetes.io/projected/813060b8-d174-4835-aa65-ff1bac5c32b2-kube-api-access-7mkff\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.284582 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.284523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/813060b8-d174-4835-aa65-ff1bac5c32b2-signing-cabundle\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.284642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.284609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/813060b8-d174-4835-aa65-ff1bac5c32b2-signing-key\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.385514 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.385494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/813060b8-d174-4835-aa65-ff1bac5c32b2-signing-cabundle\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.385640 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.385547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/813060b8-d174-4835-aa65-ff1bac5c32b2-signing-key\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.385778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.385756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mkff\" (UniqueName: \"kubernetes.io/projected/813060b8-d174-4835-aa65-ff1bac5c32b2-kube-api-access-7mkff\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.386327 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.386298 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/813060b8-d174-4835-aa65-ff1bac5c32b2-signing-cabundle\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.387893 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.387873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/813060b8-d174-4835-aa65-ff1bac5c32b2-signing-key\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.394443 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.394422 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mkff\" (UniqueName: \"kubernetes.io/projected/813060b8-d174-4835-aa65-ff1bac5c32b2-kube-api-access-7mkff\") pod \"service-ca-58598695f7-kjgwp\" (UID: \"813060b8-d174-4835-aa65-ff1bac5c32b2\") " pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.493860 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.493805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-kjgwp" Jul 20 16:14:33.563837 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.563814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:33.665304 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.665278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:33.704241 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.704219 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-kjgwp"] Jul 20 16:14:33.706459 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:33.706432 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813060b8_d174_4835_aa65_ff1bac5c32b2.slice/crio-265b8319c10d084031c9194c3458c61bb33f08aa94f111a1ac856f804db53c0c WatchSource:0}: Error finding container 265b8319c10d084031c9194c3458c61bb33f08aa94f111a1ac856f804db53c0c: Status 404 returned error can't find the container with id 265b8319c10d084031c9194c3458c61bb33f08aa94f111a1ac856f804db53c0c Jul 20 16:14:33.888547 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.888515 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" event={"ID":"4473d8c9-9dcd-4729-8447-ab9c09fe6bfd","Type":"ContainerStarted","Data":"ccca21f78c06eb98a6dda524b1df5ab33695068b41d66805e564409eadea0b3b"} Jul 20 16:14:33.889001 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.888580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" event={"ID":"4473d8c9-9dcd-4729-8447-ab9c09fe6bfd","Type":"ContainerStarted","Data":"6dde56c54cbbd0defb40e9e3055f8df474327d568a1e0d3b11bd95d48f69cd48"} Jul 20 16:14:33.890099 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.890071 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-kjgwp" event={"ID":"813060b8-d174-4835-aa65-ff1bac5c32b2","Type":"ContainerStarted","Data":"dc9f846610f641f980f5eb6766417b6425acfe117b983971241197536eec199b"} Jul 20 16:14:33.890197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.890119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-kjgwp" event={"ID":"813060b8-d174-4835-aa65-ff1bac5c32b2","Type":"ContainerStarted","Data":"265b8319c10d084031c9194c3458c61bb33f08aa94f111a1ac856f804db53c0c"} Jul 20 16:14:33.906979 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.906939 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-t4wsn" podStartSLOduration=1.102424632 podStartE2EDuration="2.906926844s" totalImagesPullingTime="1.804502212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:33.905801171 +0000 UTC m=+51.062618457" watchObservedRunningTime="2026-07-20 16:14:33.906926844 +0000 UTC m=+51.063744131" Jul 20 16:14:33.932875 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:33.932834 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-kjgwp" podStartSLOduration=0.932820399 podStartE2EDuration="932.820399ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:33.932249447 +0000 UTC m=+51.089066806" watchObservedRunningTime="2026-07-20 16:14:33.932820399 +0000 UTC m=+51.089637687" Jul 20 16:14:34.015033 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.015010 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:34.113983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.113954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:34.149667 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.149644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fcm8b_4060d656-a1cd-4f03-92e1-5592b99589d0/node-ca/0.log" Jul 20 16:14:34.289441 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.289367 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:34.466818 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.466770 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:34.596426 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.596352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:34.596557 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.596495 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 16:14:34.596557 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.596512 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9dd64b47-x7pq8: secret "image-registry-tls" not found Jul 20 16:14:34.596694 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.596561 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls podName:c1aec7cc-440a-4986-b862-53bd2868753b nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.596546242 +0000 UTC m=+67.753363506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls") pod "image-registry-c9dd64b47-x7pq8" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b") : secret "image-registry-tls" not found Jul 20 16:14:34.697167 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.697143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:34.697270 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.697181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:34.697270 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.697249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:34.697357 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697269 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 20 16:14:34.697357 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.697291 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:34.697357 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697328 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert podName:d8d6a407-ff59-40fd-8663-058831636b28 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.697311194 +0000 UTC m=+67.854128482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-jfddt" (UID: "d8d6a407-ff59-40fd-8663-058831636b28") : secret "networking-console-plugin-cert" not found Jul 20 16:14:34.697357 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697328 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 16:14:34.697505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697362 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 16:14:34.697505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697381 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls podName:e37391c1-0eea-4704-8d79-1d3e46744d9a nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.697368604 +0000 UTC m=+67.854185883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p66mz" (UID: "e37391c1-0eea-4704-8d79-1d3e46744d9a") : secret "samples-operator-tls" not found Jul 20 16:14:34.697505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697399 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.697387934 +0000 UTC m=+67.854205217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : secret "router-metrics-certs-default" not found Jul 20 16:14:34.697505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697435 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle podName:8d9a4a99-1e0d-4fe4-b9b1-518a0372186d nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.697419009 +0000 UTC m=+67.854236279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle") pod "router-default-6d5689bf4d-xfpk9" (UID: "8d9a4a99-1e0d-4fe4-b9b1-518a0372186d") : configmap references non-existent config key: service-ca.crt Jul 20 16:14:34.697716 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.697502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:34.697716 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697645 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:34.697716 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.697704 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls podName:d11d1dbb-8796-45d2-a8e5-c4063501cd04 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.697688712 +0000 UTC m=+67.854505997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qnskx" (UID: "d11d1dbb-8796-45d2-a8e5-c4063501cd04") : secret "cluster-monitoring-operator-tls" not found Jul 20 16:14:34.798411 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.798375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:34.798682 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.798648 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 16:14:34.798801 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:34.798721 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls podName:1051119f-7bbc-4c90-bf2c-e558d052aae7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:50.798701652 +0000 UTC m=+67.955518926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls") pod "dns-default-7xdvh" (UID: "1051119f-7bbc-4c90-bf2c-e558d052aae7") : secret "dns-default-metrics-tls" not found Jul 20 16:14:34.949642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:34.949558 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xp4t9_af51abb7-967c-4c28-8d7f-bf7404e64c29/serve-healthcheck-canary/0.log" Jul 20 16:14:35.101250 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.101221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:35.101387 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.101274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:35.101443 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:35.101429 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:14:35.101492 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:35.101483 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:39.101467036 +0000 UTC m=+56.258284301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : secret "insights-runtime-extractor-tls" not found Jul 20 16:14:35.101715 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.101698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e0bf1c6-7976-46f1-b26a-057b07e287b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:35.150071 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.150048 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-t4wsn_4473d8c9-9dcd-4729-8447-ab9c09fe6bfd/migrator/0.log" Jul 20 16:14:35.306365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.306334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:35.349453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.349422 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-t4wsn_4473d8c9-9dcd-4729-8447-ab9c09fe6bfd/graceful-termination/0.log" Jul 20 16:14:35.470301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.470265 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:35.560074 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.560002 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-574jz_ec4be2c5-4708-4c5f-aa26-93a0c4385983/kube-storage-version-migrator-operator/0.log" Jul 20 16:14:35.571851 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.571825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:35.693294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.693263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:35.802152 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:35.802121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:36.022278 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:36.022249 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:37.017229 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:37.017197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:37.411980 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:37.411898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:37.471584 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:37.471556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:37.623559 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:37.623526 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:37.815396 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:37.815350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:38.211461 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:38.211379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:38.811413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:38.811379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:38.911866 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:38.911837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:39.109225 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.109144 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:39.109225 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.109201 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:39.109505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.109494 2575 scope.go:117] "RemoveContainer" containerID="4c68450124c853990fbb7f4e92eacbd68af59b7c46cefe4cf9ce0b4e3f3803c9" Jul 20 16:14:39.109671 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:39.109651 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-h9z4k_openshift-console-operator(0d231d19-8c91-4909-a694-274ab60dc28b)\"" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" podUID="0d231d19-8c91-4909-a694-274ab60dc28b" Jul 20 16:14:39.124772 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.124749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:39.135877 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.135856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:39.135975 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:39.135957 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 16:14:39.136009 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:14:39.136001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls podName:6e0bf1c6-7976-46f1-b26a-057b07e287b7 nodeName:}" failed. No retries permitted until 2026-07-20 16:14:47.135990007 +0000 UTC m=+64.292807272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2kmgp" (UID: "6e0bf1c6-7976-46f1-b26a-057b07e287b7") : secret "insights-runtime-extractor-tls" not found Jul 20 16:14:39.224849 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.224816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:39.409814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.409739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:39.491728 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:39.491696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:40.012940 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:40.012906 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:40.606268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:40.606231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:40.817268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:40.817236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:40.918648 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:40.918555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:40.968422 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:40.968388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:41.148960 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:41.148927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:41.249258 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:41.249181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:41.449893 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:41.449858 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:41.815005 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:41.814972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:42.407990 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:42.407959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:42.760945 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:42.760921 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tpr8l" Jul 20 16:14:43.013083 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:43.013012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:43.212639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:43.212589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:43.614219 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:43.614187 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:43.838137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:43.838096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:44.207574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:44.207541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:44.772900 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:44.772860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:44.871681 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:44.871650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:45.007919 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:45.007884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:45.212654 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:45.212603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:45.611771 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:45.611738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:45.809915 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:45.809881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:46.011981 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:46.011951 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:47.198683 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:47.198649 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:47.200853 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:47.200833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e0bf1c6-7976-46f1-b26a-057b07e287b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kmgp\" (UID: \"6e0bf1c6-7976-46f1-b26a-057b07e287b7\") " pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:47.269035 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:47.269010 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzr47\"" Jul 20 16:14:47.277191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:47.277172 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2kmgp" Jul 20 16:14:47.398246 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:47.398162 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2kmgp"] Jul 20 16:14:47.400248 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:47.400225 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0bf1c6_7976_46f1_b26a_057b07e287b7.slice/crio-eb81b0a6fdaa86346dbaae34a7069e4d2423235d8eaf6be3a8c54614e6e3852d WatchSource:0}: Error finding container eb81b0a6fdaa86346dbaae34a7069e4d2423235d8eaf6be3a8c54614e6e3852d: Status 404 returned error can't find the container with id eb81b0a6fdaa86346dbaae34a7069e4d2423235d8eaf6be3a8c54614e6e3852d Jul 20 16:14:47.937512 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:47.937471 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kmgp" event={"ID":"6e0bf1c6-7976-46f1-b26a-057b07e287b7","Type":"ContainerStarted","Data":"eb81b0a6fdaa86346dbaae34a7069e4d2423235d8eaf6be3a8c54614e6e3852d"} Jul 20 16:14:49.220033 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.217091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:49.220594 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.220569 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:14:49.230002 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.229979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc35a328-6923-4e53-be30-b847b0217224-metrics-certs\") pod \"network-metrics-daemon-gk5h7\" (UID: \"cc35a328-6923-4e53-be30-b847b0217224\") " pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:49.318033 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.317998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:49.318174 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.318092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:49.320722 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.320697 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:14:49.321148 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.321126 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n428m\" (UniqueName: \"kubernetes.io/projected/068b72d1-0d1b-4239-bcc5-4fa836f67953-kube-api-access-n428m\") pod \"network-check-target-bw2dc\" (UID: \"068b72d1-0d1b-4239-bcc5-4fa836f67953\") " pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:49.331176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.331148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e-original-pull-secret\") pod \"global-pull-secret-syncer-pbdpb\" (UID: \"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e\") " pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:49.380713 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.380688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:49.416667 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.416640 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pbdpb" Jul 20 16:14:49.429973 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.429950 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fbfhg\"" Jul 20 16:14:49.432481 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.432408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:49.437536 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.437516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk5h7" Jul 20 16:14:49.438911 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.438883 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sngxb\"" Jul 20 16:14:49.447208 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.447135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:49.601002 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:49.600972 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe7631c_9399_4c7b_a8c2_c7ea1cfc8b7e.slice/crio-4ed3289ad49885083743051dd88db92056e496b1d3d660c698ff0ebfd4126921 WatchSource:0}: Error finding container 4ed3289ad49885083743051dd88db92056e496b1d3d660c698ff0ebfd4126921: Status 404 returned error can't find the container with id 4ed3289ad49885083743051dd88db92056e496b1d3d660c698ff0ebfd4126921 Jul 20 16:14:49.603046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.602812 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pbdpb"] Jul 20 16:14:49.616830 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.616803 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gk5h7"] Jul 20 16:14:49.619505 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:49.619471 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc35a328_6923_4e53_be30_b847b0217224.slice/crio-660e95e27e0d195c6ba65e6ac110675c8464fe9928e07d18da367d878c6839db WatchSource:0}: Error finding container 660e95e27e0d195c6ba65e6ac110675c8464fe9928e07d18da367d878c6839db: Status 404 returned error can't find the container with id 660e95e27e0d195c6ba65e6ac110675c8464fe9928e07d18da367d878c6839db Jul 20 16:14:49.633350 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.633333 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bw2dc"] Jul 20 16:14:49.635850 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:49.635829 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068b72d1_0d1b_4239_bcc5_4fa836f67953.slice/crio-48e9bc918cb28d9dbaa8e8ba0b84b9e4da97c62e5457a241d46b0302620187d1 WatchSource:0}: Error finding container 48e9bc918cb28d9dbaa8e8ba0b84b9e4da97c62e5457a241d46b0302620187d1: Status 404 returned error can't find the container with id 48e9bc918cb28d9dbaa8e8ba0b84b9e4da97c62e5457a241d46b0302620187d1 Jul 20 16:14:49.945539 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.945496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bw2dc" event={"ID":"068b72d1-0d1b-4239-bcc5-4fa836f67953","Type":"ContainerStarted","Data":"63d02809f29a0d9e595e3bb71389e7aadb6ddc5737505b3b1a0acdd494ad0602"} Jul 20 16:14:49.945761 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.945563 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bw2dc" event={"ID":"068b72d1-0d1b-4239-bcc5-4fa836f67953","Type":"ContainerStarted","Data":"48e9bc918cb28d9dbaa8e8ba0b84b9e4da97c62e5457a241d46b0302620187d1"} Jul 20 16:14:49.945761 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.945596 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:14:49.946787 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.946761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pbdpb" event={"ID":"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e","Type":"ContainerStarted","Data":"4ed3289ad49885083743051dd88db92056e496b1d3d660c698ff0ebfd4126921"} Jul 20 16:14:49.947999 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.947974 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gk5h7" event={"ID":"cc35a328-6923-4e53-be30-b847b0217224","Type":"ContainerStarted","Data":"660e95e27e0d195c6ba65e6ac110675c8464fe9928e07d18da367d878c6839db"} Jul 20 16:14:49.961334 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:49.961286 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bw2dc" podStartSLOduration=66.961269775 podStartE2EDuration="1m6.961269775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:49.960287976 +0000 UTC m=+67.117105268" watchObservedRunningTime="2026-07-20 16:14:49.961269775 +0000 UTC m=+67.118087047" Jul 20 16:14:50.632392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.632340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:50.634995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.634970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"image-registry-c9dd64b47-x7pq8\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:50.733606 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.733572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:50.733781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.733641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:50.733781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.733694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:50.733781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.733758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:50.733954 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.733791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:50.734386 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.734338 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-service-ca-bundle\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:50.736989 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.736963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d9a4a99-1e0d-4fe4-b9b1-518a0372186d-metrics-certs\") pod \"router-default-6d5689bf4d-xfpk9\" (UID: \"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d\") " pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:50.737477 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.737437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d11d1dbb-8796-45d2-a8e5-c4063501cd04-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qnskx\" (UID: \"d11d1dbb-8796-45d2-a8e5-c4063501cd04\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:50.737598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.737499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8d6a407-ff59-40fd-8663-058831636b28-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-jfddt\" (UID: \"d8d6a407-ff59-40fd-8663-058831636b28\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:50.737689 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.737656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e37391c1-0eea-4704-8d79-1d3e46744d9a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p66mz\" (UID: \"e37391c1-0eea-4704-8d79-1d3e46744d9a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:50.823370 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.823331 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5btcg\"" Jul 20 16:14:50.831734 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.831708 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:50.835248 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.835222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:50.838123 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.838100 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1051119f-7bbc-4c90-bf2c-e558d052aae7-metrics-tls\") pod \"dns-default-7xdvh\" (UID: \"1051119f-7bbc-4c90-bf2c-e558d052aae7\") " pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:50.871665 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.871640 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c9xwf\"" Jul 20 16:14:50.879881 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.879861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" Jul 20 16:14:50.885763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.885744 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wwxlp\"" Jul 20 16:14:50.893841 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.893820 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" Jul 20 16:14:50.933998 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.933976 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zdsmt\"" Jul 20 16:14:50.942151 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.942130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" Jul 20 16:14:50.950066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.950048 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h2x74\"" Jul 20 16:14:50.958233 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:50.958212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:51.018327 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:51.018298 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tgrd\"" Jul 20 16:14:51.026649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:51.026628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xdvh" Jul 20 16:14:52.673058 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.672955 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt"] Jul 20 16:14:52.763521 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.763497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5689bf4d-xfpk9"] Jul 20 16:14:52.868222 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:52.868188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d6a407_ff59_40fd_8663_058831636b28.slice/crio-da4041e7fde5186490252c3ed073e0f160bba6dee5a632ebf9e4fc2f6cec5a5c WatchSource:0}: Error finding container da4041e7fde5186490252c3ed073e0f160bba6dee5a632ebf9e4fc2f6cec5a5c: Status 404 returned error can't find the container with id da4041e7fde5186490252c3ed073e0f160bba6dee5a632ebf9e4fc2f6cec5a5c Jul 20 16:14:52.869143 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:52.869117 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9a4a99_1e0d_4fe4_b9b1_518a0372186d.slice/crio-70394e494ea522656de54fdcf7c48a4681a539c79e47323acb68ab4312d79dae WatchSource:0}: Error finding container 70394e494ea522656de54fdcf7c48a4681a539c79e47323acb68ab4312d79dae: Status 404 returned error can't find the container with id 70394e494ea522656de54fdcf7c48a4681a539c79e47323acb68ab4312d79dae Jul 20 16:14:52.912195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.911878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz"] Jul 20 16:14:52.915312 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.915252 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx"] Jul 20 16:14:52.917510 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.916109 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7xdvh"] Jul 20 16:14:52.917510 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.917372 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9dd64b47-x7pq8"] Jul 20 16:14:52.922926 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:52.922885 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11d1dbb_8796_45d2_a8e5_c4063501cd04.slice/crio-5f26c4b2184f69b8bcfe750ff4eafd68c4263863ccac7c69f2ea9c2cf21201b5 WatchSource:0}: Error finding container 5f26c4b2184f69b8bcfe750ff4eafd68c4263863ccac7c69f2ea9c2cf21201b5: Status 404 returned error can't find the container with id 5f26c4b2184f69b8bcfe750ff4eafd68c4263863ccac7c69f2ea9c2cf21201b5 Jul 20 16:14:52.923797 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:52.923765 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1051119f_7bbc_4c90_bf2c_e558d052aae7.slice/crio-5fe29683972a9babad9a387d900b8ec2d5d0d7dea59ed37dbea11bd7d39d44ea WatchSource:0}: Error finding container 5fe29683972a9babad9a387d900b8ec2d5d0d7dea59ed37dbea11bd7d39d44ea: Status 404 returned error can't find the container with id 5fe29683972a9babad9a387d900b8ec2d5d0d7dea59ed37dbea11bd7d39d44ea Jul 20 16:14:52.925036 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:52.925010 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1aec7cc_440a_4986_b862_53bd2868753b.slice/crio-b053e218ea42da15d9c1b867916c5037788c909f2caf11df87412774ecf4a215 WatchSource:0}: Error finding container b053e218ea42da15d9c1b867916c5037788c909f2caf11df87412774ecf4a215: Status 404 returned error can't find the container with id b053e218ea42da15d9c1b867916c5037788c909f2caf11df87412774ecf4a215 Jul 20 16:14:52.981201 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.981162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" event={"ID":"d11d1dbb-8796-45d2-a8e5-c4063501cd04","Type":"ContainerStarted","Data":"5f26c4b2184f69b8bcfe750ff4eafd68c4263863ccac7c69f2ea9c2cf21201b5"} Jul 20 16:14:52.988131 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.988039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" event={"ID":"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d","Type":"ContainerStarted","Data":"534f0faf82336bbd82c88a90b11c26b2b4a3f9f8616e9be0bf073fa1395ca29a"} Jul 20 16:14:52.988131 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.988096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" event={"ID":"8d9a4a99-1e0d-4fe4-b9b1-518a0372186d","Type":"ContainerStarted","Data":"70394e494ea522656de54fdcf7c48a4681a539c79e47323acb68ab4312d79dae"} Jul 20 16:14:52.991741 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.991712 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" event={"ID":"c1aec7cc-440a-4986-b862-53bd2868753b","Type":"ContainerStarted","Data":"b053e218ea42da15d9c1b867916c5037788c909f2caf11df87412774ecf4a215"} Jul 20 16:14:52.996862 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:52.996810 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xdvh" event={"ID":"1051119f-7bbc-4c90-bf2c-e558d052aae7","Type":"ContainerStarted","Data":"5fe29683972a9babad9a387d900b8ec2d5d0d7dea59ed37dbea11bd7d39d44ea"} Jul 20 16:14:53.002445 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.002402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" event={"ID":"d8d6a407-ff59-40fd-8663-058831636b28","Type":"ContainerStarted","Data":"da4041e7fde5186490252c3ed073e0f160bba6dee5a632ebf9e4fc2f6cec5a5c"} Jul 20 16:14:53.005676 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.005627 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" podStartSLOduration=43.005599099 podStartE2EDuration="43.005599099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:53.005304781 +0000 UTC m=+70.162122071" watchObservedRunningTime="2026-07-20 16:14:53.005599099 +0000 UTC m=+70.162416387" Jul 20 16:14:53.479178 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.478956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:53.566415 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.566382 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp"] Jul 20 16:14:53.570645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.569994 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l"] Jul 20 16:14:53.570645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.570142 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.574361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.573702 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 16:14:53.574361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.573952 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 16:14:53.574361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.574213 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 20 16:14:53.576209 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.575004 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz"] Jul 20 16:14:53.576209 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.575269 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 16:14:53.576209 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.575551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.579319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.579281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.580358 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.580230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 20 16:14:53.581341 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.580734 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 20 16:14:53.581341 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.580950 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 20 16:14:53.581341 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.581198 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 20 16:14:53.582095 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.582078 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 20 16:14:53.583269 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.583239 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t9jdc\"" Jul 20 16:14:53.591256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.591204 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp"] Jul 20 16:14:53.592915 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.592899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz"] Jul 20 16:14:53.594330 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.594233 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l"] Jul 20 16:14:53.623630 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.623548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:53.664325 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.664463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-ca\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.664463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-hub\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.664463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqkd\" (UniqueName: \"kubernetes.io/projected/37dc54af-55c7-45d0-ac6a-fe66ee13c5b6-kube-api-access-nnqkd\") pod \"managed-serviceaccount-addon-agent-58b5c99654-xttcz\" (UID: \"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.664463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63c9c4df-8744-42df-bd93-554137993833-tmp\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.664696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/879624ed-4fa0-4548-b9d5-3d61cc8fe776-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.664696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/63c9c4df-8744-42df-bd93-554137993833-klusterlet-config\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.664696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbqjx\" (UniqueName: \"kubernetes.io/projected/63c9c4df-8744-42df-bd93-554137993833-kube-api-access-cbqjx\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.664696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dtmw\" (UniqueName: \"kubernetes.io/projected/879624ed-4fa0-4548-b9d5-3d61cc8fe776-kube-api-access-6dtmw\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.664696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37dc54af-55c7-45d0-ac6a-fe66ee13c5b6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58b5c99654-xttcz\" (UID: \"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.664696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.664652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.709204 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.709174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:53.765516 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.765484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37dc54af-55c7-45d0-ac6a-fe66ee13c5b6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58b5c99654-xttcz\" (UID: \"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.765695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.765530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.766151 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.766256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-ca\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.766256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-hub\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.766256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqkd\" (UniqueName: \"kubernetes.io/projected/37dc54af-55c7-45d0-ac6a-fe66ee13c5b6-kube-api-access-nnqkd\") pod \"managed-serviceaccount-addon-agent-58b5c99654-xttcz\" (UID: \"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.766413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63c9c4df-8744-42df-bd93-554137993833-tmp\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.766413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/879624ed-4fa0-4548-b9d5-3d61cc8fe776-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.766413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/63c9c4df-8744-42df-bd93-554137993833-klusterlet-config\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.766413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbqjx\" (UniqueName: \"kubernetes.io/projected/63c9c4df-8744-42df-bd93-554137993833-kube-api-access-cbqjx\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.766413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.766397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dtmw\" (UniqueName: \"kubernetes.io/projected/879624ed-4fa0-4548-b9d5-3d61cc8fe776-kube-api-access-6dtmw\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.767546 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.767263 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63c9c4df-8744-42df-bd93-554137993833-tmp\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.769277 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.769107 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/879624ed-4fa0-4548-b9d5-3d61cc8fe776-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.770840 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.770797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.772883 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.772689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-hub\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.773671 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.773631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/63c9c4df-8744-42df-bd93-554137993833-klusterlet-config\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.774824 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.774496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.775317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.775296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/879624ed-4fa0-4548-b9d5-3d61cc8fe776-ca\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.779221 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.777500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqkd\" (UniqueName: \"kubernetes.io/projected/37dc54af-55c7-45d0-ac6a-fe66ee13c5b6-kube-api-access-nnqkd\") pod \"managed-serviceaccount-addon-agent-58b5c99654-xttcz\" (UID: \"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.779948 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.779835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37dc54af-55c7-45d0-ac6a-fe66ee13c5b6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58b5c99654-xttcz\" (UID: \"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.781084 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.781042 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dtmw\" (UniqueName: \"kubernetes.io/projected/879624ed-4fa0-4548-b9d5-3d61cc8fe776-kube-api-access-6dtmw\") pod \"cluster-proxy-proxy-agent-77d97c89dd-zr54l\" (UID: \"879624ed-4fa0-4548-b9d5-3d61cc8fe776\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.782445 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.782399 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbqjx\" (UniqueName: \"kubernetes.io/projected/63c9c4df-8744-42df-bd93-554137993833-kube-api-access-cbqjx\") pod \"klusterlet-addon-workmgr-5456fc76fb-fm6zp\" (UID: \"63c9c4df-8744-42df-bd93-554137993833\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.809875 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.809684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:53.893298 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.893255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:14:53.909563 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.909466 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:53.925637 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.925354 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" Jul 20 16:14:53.932910 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.932656 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" Jul 20 16:14:53.959263 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.959147 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:53.976016 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.975491 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:53.979227 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:53.979149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:54.020880 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.020780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kmgp" event={"ID":"6e0bf1c6-7976-46f1-b26a-057b07e287b7","Type":"ContainerStarted","Data":"60b1f5d033f4e578ef107e89796111832f20d7a5d6ad94b36eac2c0364f6e84e"} Jul 20 16:14:54.024817 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.024524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gk5h7" event={"ID":"cc35a328-6923-4e53-be30-b847b0217224","Type":"ContainerStarted","Data":"274babf83d85f96cfbd0215dbae52aaecf70d1849c93bae0ae85b70849faedbd"} Jul 20 16:14:54.024817 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.024578 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gk5h7" event={"ID":"cc35a328-6923-4e53-be30-b847b0217224","Type":"ContainerStarted","Data":"a498c4eba3fcf31c67ea9fbb9fdf2e833126ba2de209d2c6b85250fc1407a520"} Jul 20 16:14:54.039524 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.039390 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" event={"ID":"c1aec7cc-440a-4986-b862-53bd2868753b","Type":"ContainerStarted","Data":"dc053ad19eeb3cb0f6e0d28d7f5281af6ab199812f7af565ad8ad742e393fe03"} Jul 20 16:14:54.039524 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.039441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:14:54.043521 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.043390 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gk5h7" podStartSLOduration=67.738963911 podStartE2EDuration="1m11.043259302s" totalImagesPullingTime="3.304295391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:54.041575291 +0000 UTC m=+71.198392582" watchObservedRunningTime="2026-07-20 16:14:54.043259302 +0000 UTC m=+71.200076592" Jul 20 16:14:54.046211 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.046183 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" event={"ID":"e37391c1-0eea-4704-8d79-1d3e46744d9a","Type":"ContainerStarted","Data":"eadfc9994b0d29609218de360059047b6f6659b641d9760d466df3dc4220d7de"} Jul 20 16:14:54.046453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.046403 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:54.047747 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.047720 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d5689bf4d-xfpk9" Jul 20 16:14:54.079769 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.079702 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" podStartSLOduration=48.079680215 podStartE2EDuration="48.079680215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:54.063709775 +0000 UTC m=+71.220527063" watchObservedRunningTime="2026-07-20 16:14:54.079680215 +0000 UTC m=+71.236497504" Jul 20 16:14:54.080219 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.080186 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp"] Jul 20 16:14:54.084715 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:54.084539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c9c4df_8744_42df_bd93_554137993833.slice/crio-df4c604ef353666420412b70f0d110f9c2a2d33e8d6bcda8891ece5595b4c7ef WatchSource:0}: Error finding container df4c604ef353666420412b70f0d110f9c2a2d33e8d6bcda8891ece5595b4c7ef: Status 404 returned error can't find the container with id df4c604ef353666420412b70f0d110f9c2a2d33e8d6bcda8891ece5595b4c7ef Jul 20 16:14:54.202512 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.201206 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l"] Jul 20 16:14:54.211519 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:54.211481 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod879624ed_4fa0_4548_b9d5_3d61cc8fe776.slice/crio-93d8754177954e5805b05d9dca189a9c73e524650cd203bf99ccbccb510000f9 WatchSource:0}: Error finding container 93d8754177954e5805b05d9dca189a9c73e524650cd203bf99ccbccb510000f9: Status 404 returned error can't find the container with id 93d8754177954e5805b05d9dca189a9c73e524650cd203bf99ccbccb510000f9 Jul 20 16:14:54.223659 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.223367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz"] Jul 20 16:14:54.597124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.597088 2575 scope.go:117] "RemoveContainer" containerID="4c68450124c853990fbb7f4e92eacbd68af59b7c46cefe4cf9ce0b4e3f3803c9" Jul 20 16:14:54.619005 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.618973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:54.687443 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:54.687391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:54.954496 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:14:54.954458 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37dc54af_55c7_45d0_ac6a_fe66ee13c5b6.slice/crio-7c4f70b6f1b5d921529ad2eb1585b9f448cfc603a872fdfe8eebfbdd893c5955 WatchSource:0}: Error finding container 7c4f70b6f1b5d921529ad2eb1585b9f448cfc603a872fdfe8eebfbdd893c5955: Status 404 returned error can't find the container with id 7c4f70b6f1b5d921529ad2eb1585b9f448cfc603a872fdfe8eebfbdd893c5955 Jul 20 16:14:55.002003 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.001957 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:55.061680 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.061652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" event={"ID":"63c9c4df-8744-42df-bd93-554137993833","Type":"ContainerStarted","Data":"df4c604ef353666420412b70f0d110f9c2a2d33e8d6bcda8891ece5595b4c7ef"} Jul 20 16:14:55.064011 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.063731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" event={"ID":"879624ed-4fa0-4548-b9d5-3d61cc8fe776","Type":"ContainerStarted","Data":"93d8754177954e5805b05d9dca189a9c73e524650cd203bf99ccbccb510000f9"} Jul 20 16:14:55.065235 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.065208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" event={"ID":"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6","Type":"ContainerStarted","Data":"7c4f70b6f1b5d921529ad2eb1585b9f448cfc603a872fdfe8eebfbdd893c5955"} Jul 20 16:14:55.076108 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.074905 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:14:55.076108 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.075578 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" event={"ID":"0d231d19-8c91-4909-a694-274ab60dc28b","Type":"ContainerStarted","Data":"d68b9f2d1558607aef9fb47cc29787fbb4462fb54e8105c3a15f4c426d32b214"} Jul 20 16:14:55.077532 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.077473 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:55.079583 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.079315 2575 patch_prober.go:28] interesting pod/console-operator-565b7b569d-h9z4k container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 20 16:14:55.079583 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.079365 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" podUID="0d231d19-8c91-4909-a694-274ab60dc28b" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.16:8443/readyz\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 20 16:14:55.099504 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.099350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:55.107378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:55.107305 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" podStartSLOduration=35.980243123 podStartE2EDuration="46.107284914s" totalImagesPullingTime="10.127041791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:55.103161024 +0000 UTC m=+72.259978306" watchObservedRunningTime="2026-07-20 16:14:55.107284914 +0000 UTC m=+72.264102192" Jul 20 16:14:56.085774 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.085654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" event={"ID":"d8d6a407-ff59-40fd-8663-058831636b28","Type":"ContainerStarted","Data":"4679425dbf33eac679dd3a0d81049a0b902f0f1fc42ead57e4a014a64fc741c2"} Jul 20 16:14:56.231096 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.231033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:56.293267 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.293219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:56.347739 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.347599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:56.454054 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.453605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-h9z4k" Jul 20 16:14:56.471593 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.471531 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-jfddt" podStartSLOduration=44.338146 podStartE2EDuration="46.471509695s" totalImagesPullingTime="2.133363695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:56.103172803 +0000 UTC m=+73.259990092" watchObservedRunningTime="2026-07-20 16:14:56.471509695 +0000 UTC m=+73.628326986" Jul 20 16:14:56.654510 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.654419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:56.718101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.718054 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:56.820753 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.820667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:56.918443 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:56.918363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.032342 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.032231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.133405 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.133225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.318272 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.318197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.506037 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.505999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.559108 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.559071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.707009 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.706900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:57.760830 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:57.760769 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:58.524455 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:58.524419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:58.718318 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:58.718286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:59.278469 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:59.278438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:59.349095 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:59.349068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:59.398387 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:59.398359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:59.734047 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:59.733958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:59.799177 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:14:59.799143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:04.384445 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:04.384406 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:04.484948 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:04.484917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:06.194063 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:06.193930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:06.248428 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:06.248388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:06.978051 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:06.978019 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:07.078263 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.078089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:07.151227 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.149223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pbdpb" event={"ID":"5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e","Type":"ContainerStarted","Data":"585d501c469e8ea8a5b5c3c3dfa2416d921188c123b7142be275f018682d77e3"} Jul 20 16:15:07.183089 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.182126 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" event={"ID":"e37391c1-0eea-4704-8d79-1d3e46744d9a","Type":"ContainerStarted","Data":"87cd68f6b668efe8fbeb8d4b56065f82e66356682dd089ffc2abc1467a753319"} Jul 20 16:15:07.186373 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.185924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kmgp" event={"ID":"6e0bf1c6-7976-46f1-b26a-057b07e287b7","Type":"ContainerStarted","Data":"23c8efb2eb14e1d1ded5b99e9d2a305b3bbc9549caf8d99476c8f752dab2a289"} Jul 20 16:15:07.190677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.190585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xdvh" event={"ID":"1051119f-7bbc-4c90-bf2c-e558d052aae7","Type":"ContainerStarted","Data":"abe682c4e5a089c3c99f5f79902df63af0270cbaeed5cbf2f1ba0d351fe24074"} Jul 20 16:15:07.194743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.193751 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" event={"ID":"63c9c4df-8744-42df-bd93-554137993833","Type":"ContainerStarted","Data":"3a4ea225bba6e821db94a3548e95aec37977d6a1b38fd3143e5e3bdf2d0b2d03"} Jul 20 16:15:07.196274 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.196101 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:15:07.197895 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.197722 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" Jul 20 16:15:07.200421 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.200354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" event={"ID":"879624ed-4fa0-4548-b9d5-3d61cc8fe776","Type":"ContainerStarted","Data":"510d0cb84c5b78ca382f6e1d5b9d9ecf37c0955ce0fb5d8bb69d5e6c5aab3624"} Jul 20 16:15:07.206907 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.206129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" event={"ID":"d11d1dbb-8796-45d2-a8e5-c4063501cd04","Type":"ContainerStarted","Data":"942662b168b2093308e82e21b6c608b0cffdf63d6c149774dcf1ec36a1cf46e5"} Jul 20 16:15:07.210245 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.209745 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" event={"ID":"37dc54af-55c7-45d0-ac6a-fe66ee13c5b6","Type":"ContainerStarted","Data":"09a9a17e50638eec4686196d8bc61aeca896a9cc66b5ddeeb1071acb8cbd276d"} Jul 20 16:15:07.212816 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.211181 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5456fc76fb-fm6zp" podStartSLOduration=1.38533623 podStartE2EDuration="14.211162908s" totalImagesPullingTime="12.825826678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:07.210252478 +0000 UTC m=+84.367069766" watchObservedRunningTime="2026-07-20 16:15:07.211162908 +0000 UTC m=+84.367980197" Jul 20 16:15:07.212816 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.211473 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pbdpb" podStartSLOduration=67.052628066 podStartE2EDuration="1m24.21146548s" totalImagesPullingTime="17.158837414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:07.173029443 +0000 UTC m=+84.329846737" watchObservedRunningTime="2026-07-20 16:15:07.21146548 +0000 UTC m=+84.368282767" Jul 20 16:15:07.250492 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.250434 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qnskx" podStartSLOduration=43.41456766 podStartE2EDuration="57.250413243s" totalImagesPullingTime="13.835845583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:07.228744261 +0000 UTC m=+84.385561551" watchObservedRunningTime="2026-07-20 16:15:07.250413243 +0000 UTC m=+84.407230523" Jul 20 16:15:07.267062 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.266698 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58b5c99654-xttcz" podStartSLOduration=2.333923537 podStartE2EDuration="14.266682903s" totalImagesPullingTime="11.932759366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:07.26525019 +0000 UTC m=+84.422067491" watchObservedRunningTime="2026-07-20 16:15:07.266682903 +0000 UTC m=+84.423500168" Jul 20 16:15:07.363932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.363900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:07.467526 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.467450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:07.549824 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.549793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:07.662069 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:07.662030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:08.217398 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.217355 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" event={"ID":"879624ed-4fa0-4548-b9d5-3d61cc8fe776","Type":"ContainerStarted","Data":"0de4091a9092427435508b327100d24bf006376e5fe806f2a81894858b2856ca"} Jul 20 16:15:08.217871 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.217406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" event={"ID":"879624ed-4fa0-4548-b9d5-3d61cc8fe776","Type":"ContainerStarted","Data":"ff23868fad5a9116b3800312b691969b6644ca78f102acdd0dd6074008197fa2"} Jul 20 16:15:08.219524 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.219495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" event={"ID":"e37391c1-0eea-4704-8d79-1d3e46744d9a","Type":"ContainerStarted","Data":"7b508a1f5ccea2e44524c4c4a0b6c22acafd6be19066a69aa0ff74e2223c8cd1"} Jul 20 16:15:08.222014 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.221988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xdvh" event={"ID":"1051119f-7bbc-4c90-bf2c-e558d052aae7","Type":"ContainerStarted","Data":"a75dc3ae9c675ae9a9781a476afb7d0e6b4a54dd017f7e5a370f545d7cf9597b"} Jul 20 16:15:08.222122 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.222070 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7xdvh" Jul 20 16:15:08.235948 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.235884 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77d97c89dd-zr54l" podStartSLOduration=2.5568681939999998 podStartE2EDuration="15.235864655s" totalImagesPullingTime="12.678996461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:08.232955885 +0000 UTC m=+85.389773174" watchObservedRunningTime="2026-07-20 16:15:08.235864655 +0000 UTC m=+85.392681924" Jul 20 16:15:08.249241 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.249173 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p66mz" podStartSLOduration=44.463165358 podStartE2EDuration="58.249161012s" totalImagesPullingTime="13.785995654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:08.247652875 +0000 UTC m=+85.404470165" watchObservedRunningTime="2026-07-20 16:15:08.249161012 +0000 UTC m=+85.405978299" Jul 20 16:15:08.266038 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:08.265991 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7xdvh" podStartSLOduration=36.428857992 podStartE2EDuration="50.26597817s" totalImagesPullingTime="13.837120178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:08.265782762 +0000 UTC m=+85.422600052" watchObservedRunningTime="2026-07-20 16:15:08.26597817 +0000 UTC m=+85.422795457" Jul 20 16:15:10.836361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:10.836287 2575 patch_prober.go:28] interesting pod/image-registry-c9dd64b47-x7pq8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 16:15:10.836361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:10.836337 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" podUID="c1aec7cc-440a-4986-b862-53bd2868753b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:15:11.237872 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:11.237789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kmgp" event={"ID":"6e0bf1c6-7976-46f1-b26a-057b07e287b7","Type":"ContainerStarted","Data":"040b9643a0ef06450005800bd3f3a4cd0f8286840a4cab0341c2c34cffdac34c"} Jul 20 16:15:11.255191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:11.255144 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2kmgp" podStartSLOduration=17.325731832 podStartE2EDuration="40.255129798s" totalImagesPullingTime="22.929397966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:14:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:11.254174255 +0000 UTC m=+88.410991542" watchObservedRunningTime="2026-07-20 16:15:11.255129798 +0000 UTC m=+88.411947095" Jul 20 16:15:12.571477 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:12.571437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:12.634012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:12.633976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:12.688785 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:12.688737 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:14.543513 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:14.543475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:14.616673 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:14.616636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:14.835357 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:14.835278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:15.081019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:15.080993 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:15:15.385018 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:15.384981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:15.439723 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:15.439689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:16.335310 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:16.335262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:16.436311 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:16.436280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:18.147773 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:18.147744 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9dd64b47-x7pq8"] Jul 20 16:15:18.225777 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:18.225741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:18.232434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:18.232410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7xdvh" Jul 20 16:15:18.325397 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:18.325360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:18.374753 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:18.374720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:19.372588 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:19.372558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:19.458138 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:19.458104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.235484 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:20.235450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.335162 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:20.335131 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.461778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:20.461749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.728312 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:20.728281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.787463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:20.787437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.954830 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:20.954799 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bw2dc" Jul 20 16:15:21.144324 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:21.144282 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:21.195740 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:21.195710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:22.848572 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.848538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:22.923612 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.923575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:22.945245 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.945215 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pgdsk"] Jul 20 16:15:22.989912 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.989889 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:22.992681 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.992659 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 16:15:22.992840 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.992817 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4pfw\"" Jul 20 16:15:22.992955 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.992928 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 16:15:22.993011 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.992999 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 16:15:22.993928 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:22.993907 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 16:15:23.114821 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.114750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.114821 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.114795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-root\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.114896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5101a7-7169-4319-a72c-7896181be49d-metrics-client-ca\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.114941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.114980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-sys\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.115021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-wtmp\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.115061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-textfile\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.115084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-tls\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.115154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.115111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtxv7\" (UniqueName: \"kubernetes.io/projected/0e5101a7-7169-4319-a72c-7896181be49d-kube-api-access-gtxv7\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216263 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5101a7-7169-4319-a72c-7896181be49d-metrics-client-ca\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-sys\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-wtmp\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-textfile\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-tls\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtxv7\" (UniqueName: \"kubernetes.io/projected/0e5101a7-7169-4319-a72c-7896181be49d-kube-api-access-gtxv7\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216445 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-sys\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-root\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216683 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-wtmp\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e5101a7-7169-4319-a72c-7896181be49d-root\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.216944 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:15:23.216549 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 16:15:23.216944 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:15:23.216898 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-tls podName:0e5101a7-7169-4319-a72c-7896181be49d nodeName:}" failed. No retries permitted until 2026-07-20 16:15:23.716878822 +0000 UTC m=+100.873696092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-tls") pod "node-exporter-pgdsk" (UID: "0e5101a7-7169-4319-a72c-7896181be49d") : secret "node-exporter-tls" not found Jul 20 16:15:23.216944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.216914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e5101a7-7169-4319-a72c-7896181be49d-metrics-client-ca\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.217151 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.217094 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.217405 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.217381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-textfile\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.219215 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.219185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.225151 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.225131 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtxv7\" (UniqueName: \"kubernetes.io/projected/0e5101a7-7169-4319-a72c-7896181be49d-kube-api-access-gtxv7\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.285211 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.285118 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:23.389488 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.389390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:23.676032 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.675952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:23.721215 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.721185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-tls\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.723482 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.723461 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e5101a7-7169-4319-a72c-7896181be49d-node-exporter-tls\") pod \"node-exporter-pgdsk\" (UID: \"0e5101a7-7169-4319-a72c-7896181be49d\") " pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.776414 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.776381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:23.902158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.902122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pgdsk" Jul 20 16:15:23.919963 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.919934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:23.997384 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:23.997333 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:24.219412 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:24.219373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:24.278034 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:24.278004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:24.290150 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:24.290116 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgdsk" event={"ID":"0e5101a7-7169-4319-a72c-7896181be49d","Type":"ContainerStarted","Data":"89a454833baf55f2454e2b557fc4e1ba7e922ad9874ea9667355f9187781ec73"} Jul 20 16:15:24.468226 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:24.468191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:24.530000 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:24.529930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:25.139943 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:25.139910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:25.241184 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:25.241147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:25.851610 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:25.851584 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:25.906932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:25.906906 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:26.083374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:26.083338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:26.187765 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:26.187737 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:26.299745 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:26.299712 2575 generic.go:356] "Generic (PLEG): container finished" podID="0e5101a7-7169-4319-a72c-7896181be49d" containerID="102e99dade56c1e379f192c35982c322170dffb468ba92d007cddf2298d3d21f" exitCode=0 Jul 20 16:15:26.299910 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:26.299769 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgdsk" event={"ID":"0e5101a7-7169-4319-a72c-7896181be49d","Type":"ContainerDied","Data":"102e99dade56c1e379f192c35982c322170dffb468ba92d007cddf2298d3d21f"} Jul 20 16:15:27.307397 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.307357 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgdsk" event={"ID":"0e5101a7-7169-4319-a72c-7896181be49d","Type":"ContainerStarted","Data":"b9b818306d9e0277a5acee4ba14b985ae880a469bfbbc3fe7f79b18fccecb4b0"} Jul 20 16:15:27.307824 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.307431 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgdsk" event={"ID":"0e5101a7-7169-4319-a72c-7896181be49d","Type":"ContainerStarted","Data":"e6c9b77d10bfaf57c015c0750c5f1fb84f663fda3fc3040bbe8fe89d9fc3a0da"} Jul 20 16:15:27.333862 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.333820 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pgdsk" podStartSLOduration=3.5880399880000002 podStartE2EDuration="5.333805158s" totalImagesPullingTime="1.680651487s" totalInitContainerRuntime="65.113683ms" isStatefulPod=true podCreationTimestamp="2026-07-20 16:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:15:27.331873322 +0000 UTC m=+104.488690621" watchObservedRunningTime="2026-07-20 16:15:27.333805158 +0000 UTC m=+104.490622445" Jul 20 16:15:27.364795 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.364757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:27.464584 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.464552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:27.708827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.708746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:27.760031 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:27.760003 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:28.074988 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:28.074958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:29.129776 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:29.129738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:29.838371 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:29.838336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:29.938628 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:29.938597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:30.430957 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:30.430928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:30.531674 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:30.531644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:34.386834 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:34.386794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:34.487159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:34.487117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:36.345307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:36.345275 2575 generic.go:356] "Generic (PLEG): container finished" podID="ff66143e-68d5-4d85-b36e-ece5c16b0583" containerID="faa2996864eca1d7e0ba7f38be0a3feff261283e897c9ede3cad67a50dacbf95" exitCode=0 Jul 20 16:15:36.345692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:36.345321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" event={"ID":"ff66143e-68d5-4d85-b36e-ece5c16b0583","Type":"ContainerDied","Data":"faa2996864eca1d7e0ba7f38be0a3feff261283e897c9ede3cad67a50dacbf95"} Jul 20 16:15:36.345692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:36.345611 2575 scope.go:117] "RemoveContainer" containerID="faa2996864eca1d7e0ba7f38be0a3feff261283e897c9ede3cad67a50dacbf95" Jul 20 16:15:37.352118 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:37.352082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pwg6b" event={"ID":"ff66143e-68d5-4d85-b36e-ece5c16b0583","Type":"ContainerStarted","Data":"4460c7a0b5d067e468cfd9705eb35e3fc24a03b80c65ee62cae0f591d2933119"} Jul 20 16:15:39.512149 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:39.512114 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:39.602606 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:39.602568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:39.889986 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:39.889901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:39.987436 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:39.987403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:40.187814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:40.187747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:40.251600 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:40.251562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:41.369207 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:41.369176 2575 generic.go:356] "Generic (PLEG): container finished" podID="ec4be2c5-4708-4c5f-aa26-93a0c4385983" containerID="998525c3279185c06d539e9e6f312e7c9ce472593541b38a074b0a9ad5209e31" exitCode=0 Jul 20 16:15:41.369565 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:41.369254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" event={"ID":"ec4be2c5-4708-4c5f-aa26-93a0c4385983","Type":"ContainerDied","Data":"998525c3279185c06d539e9e6f312e7c9ce472593541b38a074b0a9ad5209e31"} Jul 20 16:15:41.369565 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:41.369535 2575 scope.go:117] "RemoveContainer" containerID="998525c3279185c06d539e9e6f312e7c9ce472593541b38a074b0a9ad5209e31" Jul 20 16:15:41.865287 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:41.865254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:42.104720 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:42.104686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:42.155734 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:42.155651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:42.375135 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:42.375108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-574jz" event={"ID":"ec4be2c5-4708-4c5f-aa26-93a0c4385983","Type":"ContainerStarted","Data":"c84602653c3e62a2d9a21154f0d215a5a15d9ba413d6e5de4e266c64af62c5f8"} Jul 20 16:15:43.168120 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.168080 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" podUID="c1aec7cc-440a-4986-b862-53bd2868753b" containerName="registry" containerID="cri-o://dc053ad19eeb3cb0f6e0d28d7f5281af6ab199812f7af565ad8ad742e393fe03" gracePeriod=30 Jul 20 16:15:43.380398 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.380372 2575 generic.go:356] "Generic (PLEG): container finished" podID="c1aec7cc-440a-4986-b862-53bd2868753b" containerID="dc053ad19eeb3cb0f6e0d28d7f5281af6ab199812f7af565ad8ad742e393fe03" exitCode=0 Jul 20 16:15:43.380836 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.380441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" event={"ID":"c1aec7cc-440a-4986-b862-53bd2868753b","Type":"ContainerDied","Data":"dc053ad19eeb3cb0f6e0d28d7f5281af6ab199812f7af565ad8ad742e393fe03"} Jul 20 16:15:43.466498 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.466473 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:15:43.576864 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.576833 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-installation-pull-secrets\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.576879 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-image-registry-private-configuration\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.576905 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-bound-sa-token\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.576930 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-registry-certificates\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.576960 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1aec7cc-440a-4986-b862-53bd2868753b-ca-trust-extracted\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.576981 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn4kl\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-kube-api-access-jn4kl\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.577017 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.577040 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-trusted-ca\") pod \"c1aec7cc-440a-4986-b862-53bd2868753b\" (UID: \"c1aec7cc-440a-4986-b862-53bd2868753b\") " Jul 20 16:15:43.577466 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.577437 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:15:43.577615 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.577590 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:15:43.579432 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.579403 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:15:43.579633 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.579542 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:15:43.579766 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.579667 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-kube-api-access-jn4kl" (OuterVolumeSpecName: "kube-api-access-jn4kl") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "kube-api-access-jn4kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:15:43.579766 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.579731 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:15:43.579766 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.579749 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:15:43.585916 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.585892 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1aec7cc-440a-4986-b862-53bd2868753b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c1aec7cc-440a-4986-b862-53bd2868753b" (UID: "c1aec7cc-440a-4986-b862-53bd2868753b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:15:43.628132 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:15:43.628105 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1aec7cc_440a_4986_b862_53bd2868753b.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1aec7cc_440a_4986_b862_53bd2868753b.slice/crio-b053e218ea42da15d9c1b867916c5037788c909f2caf11df87412774ecf4a215\": RecentStats: unable to find data in memory cache]" Jul 20 16:15:43.677829 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677797 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-image-registry-private-configuration\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.677829 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677821 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-bound-sa-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.677829 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677830 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-registry-certificates\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.678068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677842 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1aec7cc-440a-4986-b862-53bd2868753b-ca-trust-extracted\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.678068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677854 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn4kl\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-kube-api-access-jn4kl\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.678068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677862 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1aec7cc-440a-4986-b862-53bd2868753b-registry-tls\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.678068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677870 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1aec7cc-440a-4986-b862-53bd2868753b-trusted-ca\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:43.678068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:43.677878 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1aec7cc-440a-4986-b862-53bd2868753b-installation-pull-secrets\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:15:44.389410 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:44.389375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" event={"ID":"c1aec7cc-440a-4986-b862-53bd2868753b","Type":"ContainerDied","Data":"b053e218ea42da15d9c1b867916c5037788c909f2caf11df87412774ecf4a215"} Jul 20 16:15:44.389846 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:44.389432 2575 scope.go:117] "RemoveContainer" containerID="dc053ad19eeb3cb0f6e0d28d7f5281af6ab199812f7af565ad8ad742e393fe03" Jul 20 16:15:44.389846 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:44.389391 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9dd64b47-x7pq8" Jul 20 16:15:44.407162 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:44.407141 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9dd64b47-x7pq8"] Jul 20 16:15:44.416319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:44.416299 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c9dd64b47-x7pq8"] Jul 20 16:15:45.600545 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:45.600508 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1aec7cc-440a-4986-b862-53bd2868753b" path="/var/lib/kubelet/pods/c1aec7cc-440a-4986-b862-53bd2868753b/volumes" Jul 20 16:15:49.384142 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:49.384102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:49.433803 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:15:49.433776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:00.455848 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:00.455767 2575 generic.go:356] "Generic (PLEG): container finished" podID="c8d011e9-8d9b-4585-bad2-052fcbcd3412" containerID="a3cb38996af17d233abec1503a3bfbd45039c48103fdebaa8df974f39edf2010" exitCode=0 Jul 20 16:16:00.455848 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:00.455811 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" event={"ID":"c8d011e9-8d9b-4585-bad2-052fcbcd3412","Type":"ContainerDied","Data":"a3cb38996af17d233abec1503a3bfbd45039c48103fdebaa8df974f39edf2010"} Jul 20 16:16:00.456219 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:00.456171 2575 scope.go:117] "RemoveContainer" containerID="a3cb38996af17d233abec1503a3bfbd45039c48103fdebaa8df974f39edf2010" Jul 20 16:16:01.461318 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:01.461283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5lnsb" event={"ID":"c8d011e9-8d9b-4585-bad2-052fcbcd3412","Type":"ContainerStarted","Data":"517950fd996def14c137f6aa1735703e817084c8a8d6d8247761762d9e16aa84"} Jul 20 16:16:04.377207 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:04.377166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:04.477704 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:04.477677 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:08.381021 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:08.380980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:42.117657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:42.117551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:42.636297 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:42.636247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:53.681129 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:53.681089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:53.781250 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:53.781218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:53.833742 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:53.833704 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:54.351349 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:54.351317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:55.796245 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:55.796214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:57.346840 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:57.346809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:57.408472 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:16:57.408440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:09.121106 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:09.121072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:09.176639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:09.176580 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:15.279730 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:15.279661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:15.380012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:15.379976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:15.445138 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:15.445107 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:19.392654 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:19.392608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:19.493056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:19.493027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:31.623232 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:31.623194 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:31.682555 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:17:31.682530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:03.821653 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:03.821598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:03.877199 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:03.877165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:20.060886 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:20.060796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:20.112985 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:20.112947 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:38.252995 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:38.252952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:38.725048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:38.725011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:43.265204 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:43.265169 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:18:43.270588 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:43.270564 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:18:43.272466 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:43.272447 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:18:43.276847 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:43.276819 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 16:18:43.278689 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:18:43.278673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:19:04.499484 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:04.499444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:07.685582 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:07.685549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:08.073875 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:08.073837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:08.123755 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:08.123714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:09.467475 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:09.467440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:09.638305 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:09.638272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:09.848590 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:09.848564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:09.951458 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:09.951429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:11.673879 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:11.673847 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:12.290483 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:12.290441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:14.867119 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:14.867078 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:14.934024 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:14.933997 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:16.896088 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:16.896052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:16.943941 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:16.943913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:20.881670 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:20.881634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:20.979139 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:20.979108 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:21.081314 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:21.081279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:26.910159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:26.910124 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:27.012968 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:27.012937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:28.758248 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:28.758218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:40.889295 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:40.889224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:40.983105 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:40.983074 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:41.489165 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.489125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:41.699004 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.698956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:41.814831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.814804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:41.884927 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.884901 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt"] Jul 20 16:19:41.885186 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.885174 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1aec7cc-440a-4986-b862-53bd2868753b" containerName="registry" Jul 20 16:19:41.885229 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.885188 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1aec7cc-440a-4986-b862-53bd2868753b" containerName="registry" Jul 20 16:19:41.885262 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.885256 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1aec7cc-440a-4986-b862-53bd2868753b" containerName="registry" Jul 20 16:19:41.888159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.888143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:41.890844 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.890824 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 16:19:41.891202 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.890902 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 16:19:41.891324 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.891310 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 16:19:41.891764 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.891748 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 16:19:41.891873 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.891855 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xzk42\"" Jul 20 16:19:41.909569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.909546 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt"] Jul 20 16:19:41.977597 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.977570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fbea8199-0b57-4247-b627-de32810c2753-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:41.977713 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.977600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl6gv\" (UniqueName: \"kubernetes.io/projected/fbea8199-0b57-4247-b627-de32810c2753-kube-api-access-fl6gv\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:41.977713 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.977643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbea8199-0b57-4247-b627-de32810c2753-tmp\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:41.977713 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.977704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fbea8199-0b57-4247-b627-de32810c2753-manifests\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:41.977814 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:41.977744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbea8199-0b57-4247-b627-de32810c2753-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.042490 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.042468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:42.078741 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.078690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbea8199-0b57-4247-b627-de32810c2753-tmp\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.078741 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.078730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fbea8199-0b57-4247-b627-de32810c2753-manifests\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.078876 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.078770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbea8199-0b57-4247-b627-de32810c2753-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.078876 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.078793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fbea8199-0b57-4247-b627-de32810c2753-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.078876 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.078863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl6gv\" (UniqueName: \"kubernetes.io/projected/fbea8199-0b57-4247-b627-de32810c2753-kube-api-access-fl6gv\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.079217 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.079189 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fbea8199-0b57-4247-b627-de32810c2753-manifests\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.081362 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.081336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbea8199-0b57-4247-b627-de32810c2753-tmp\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.081464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.081389 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fbea8199-0b57-4247-b627-de32810c2753-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.081527 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.081484 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fbea8199-0b57-4247-b627-de32810c2753-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.092957 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.092938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl6gv\" (UniqueName: \"kubernetes.io/projected/fbea8199-0b57-4247-b627-de32810c2753-kube-api-access-fl6gv\") pod \"opendatahub-operator-controller-manager-6bbb748554-gs5bt\" (UID: \"fbea8199-0b57-4247-b627-de32810c2753\") " pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.142859 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.142836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:42.198267 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.198242 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:42.248597 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.248553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:42.329162 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.329100 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt"] Jul 20 16:19:42.331989 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:19:42.331953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbea8199_0b57_4247_b627_de32810c2753.slice/crio-66d047bdbebd1dc68b9bb1954843aa53567ffd4a8094e1cdaec08df78efbd999 WatchSource:0}: Error finding container 66d047bdbebd1dc68b9bb1954843aa53567ffd4a8094e1cdaec08df78efbd999: Status 404 returned error can't find the container with id 66d047bdbebd1dc68b9bb1954843aa53567ffd4a8094e1cdaec08df78efbd999 Jul 20 16:19:42.335056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.335026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:42.335518 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.335499 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:19:42.395538 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.395503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:42.500229 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:42.500203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:43.308820 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:43.308791 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" event={"ID":"fbea8199-0b57-4247-b627-de32810c2753","Type":"ContainerStarted","Data":"66d047bdbebd1dc68b9bb1954843aa53567ffd4a8094e1cdaec08df78efbd999"} Jul 20 16:19:47.331254 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:47.331219 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" event={"ID":"fbea8199-0b57-4247-b627-de32810c2753","Type":"ContainerStarted","Data":"af874387963d52f1826fc178595da24848914ffe0db379c5e0c1af28f5d8e79a"} Jul 20 16:19:48.337222 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:48.337188 2575 generic.go:356] "Generic (PLEG): container finished" podID="fbea8199-0b57-4247-b627-de32810c2753" containerID="af874387963d52f1826fc178595da24848914ffe0db379c5e0c1af28f5d8e79a" exitCode=0 Jul 20 16:19:48.337600 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:48.337279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" event={"ID":"fbea8199-0b57-4247-b627-de32810c2753","Type":"ContainerDied","Data":"af874387963d52f1826fc178595da24848914ffe0db379c5e0c1af28f5d8e79a"} Jul 20 16:19:49.343397 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:49.343351 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" event={"ID":"fbea8199-0b57-4247-b627-de32810c2753","Type":"ContainerStarted","Data":"490dd1da9dd580aadaebab87c3e27e92faec492153f4e6fa9a6508aedeaca41e"} Jul 20 16:19:49.343883 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:49.343498 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:19:49.365888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:49.365845 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" podStartSLOduration=2.995347643 podStartE2EDuration="8.36583182s" totalImagesPullingTime="4.291492367s" totalInitContainerRuntime="1.07899181s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:49.364033695 +0000 UTC m=+366.520850982" watchObservedRunningTime="2026-07-20 16:19:49.36583182 +0000 UTC m=+366.522649108" Jul 20 16:19:57.754439 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:57.754379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:57.854890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:19:57.854832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:00.350465 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:00.350437 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bbb748554-gs5bt" Jul 20 16:20:01.937120 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:01.937085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:02.315164 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.315129 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:02.450051 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.450014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:02.597376 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.597309 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs"] Jul 20 16:20:02.610158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.610134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.612842 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.612819 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 20 16:20:02.612950 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.612878 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 20 16:20:02.619261 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.619239 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs"] Jul 20 16:20:02.737135 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.737104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd9741b9-0a1b-4beb-a201-48d81e62cee4-tmp\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.737303 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.737142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9741b9-0a1b-4beb-a201-48d81e62cee4-tls-certs\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.737303 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.737170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hgq\" (UniqueName: \"kubernetes.io/projected/bd9741b9-0a1b-4beb-a201-48d81e62cee4-kube-api-access-r7hgq\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.807996 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.807938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:02.825090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.825065 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cj7ch"] Jul 20 16:20:02.828224 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.828210 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:02.832133 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.832111 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8dn75\"" Jul 20 16:20:02.832560 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.832542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 20 16:20:02.837588 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.837567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd9741b9-0a1b-4beb-a201-48d81e62cee4-tmp\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.837809 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.837788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9741b9-0a1b-4beb-a201-48d81e62cee4-tls-certs\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.837889 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.837861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hgq\" (UniqueName: \"kubernetes.io/projected/bd9741b9-0a1b-4beb-a201-48d81e62cee4-kube-api-access-r7hgq\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.840196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.840169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd9741b9-0a1b-4beb-a201-48d81e62cee4-tmp\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.840512 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.840478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd9741b9-0a1b-4beb-a201-48d81e62cee4-tls-certs\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.845699 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.845671 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cj7ch"] Jul 20 16:20:02.860937 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.860890 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hgq\" (UniqueName: \"kubernetes.io/projected/bd9741b9-0a1b-4beb-a201-48d81e62cee4-kube-api-access-r7hgq\") pod \"kube-auth-proxy-5b4f98b7bc-bmbcs\" (UID: \"bd9741b9-0a1b-4beb-a201-48d81e62cee4\") " pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.922286 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.922259 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" Jul 20 16:20:02.927638 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.927588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:02.939183 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.939150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/163a41e5-766b-4137-b6d5-07229d0df573-cert\") pod \"odh-model-controller-7998c67dc4-cj7ch\" (UID: \"163a41e5-766b-4137-b6d5-07229d0df573\") " pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:02.939465 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:02.939194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8m9f\" (UniqueName: \"kubernetes.io/projected/163a41e5-766b-4137-b6d5-07229d0df573-kube-api-access-v8m9f\") pod \"odh-model-controller-7998c67dc4-cj7ch\" (UID: \"163a41e5-766b-4137-b6d5-07229d0df573\") " pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:03.040196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.040165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/163a41e5-766b-4137-b6d5-07229d0df573-cert\") pod \"odh-model-controller-7998c67dc4-cj7ch\" (UID: \"163a41e5-766b-4137-b6d5-07229d0df573\") " pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:03.040196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.040203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8m9f\" (UniqueName: \"kubernetes.io/projected/163a41e5-766b-4137-b6d5-07229d0df573-kube-api-access-v8m9f\") pod \"odh-model-controller-7998c67dc4-cj7ch\" (UID: \"163a41e5-766b-4137-b6d5-07229d0df573\") " pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:03.042503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.042478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/163a41e5-766b-4137-b6d5-07229d0df573-cert\") pod \"odh-model-controller-7998c67dc4-cj7ch\" (UID: \"163a41e5-766b-4137-b6d5-07229d0df573\") " pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:03.052754 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.052732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8m9f\" (UniqueName: \"kubernetes.io/projected/163a41e5-766b-4137-b6d5-07229d0df573-kube-api-access-v8m9f\") pod \"odh-model-controller-7998c67dc4-cj7ch\" (UID: \"163a41e5-766b-4137-b6d5-07229d0df573\") " pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:03.062242 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.062219 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs"] Jul 20 16:20:03.065608 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:20:03.065581 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd9741b9_0a1b_4beb_a201_48d81e62cee4.slice/crio-74f91a878ef63dfcec390e22c3df5466489b43c0592f3c969d94817065ea0d87 WatchSource:0}: Error finding container 74f91a878ef63dfcec390e22c3df5466489b43c0592f3c969d94817065ea0d87: Status 404 returned error can't find the container with id 74f91a878ef63dfcec390e22c3df5466489b43c0592f3c969d94817065ea0d87 Jul 20 16:20:03.072711 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.072683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:03.140102 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.140042 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:03.279304 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.279282 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cj7ch"] Jul 20 16:20:03.281026 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:20:03.280997 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163a41e5_766b_4137_b6d5_07229d0df573.slice/crio-6fc902553d074fe953ef5bdcfe734ef2ab4844994febd0c81599889db02da731 WatchSource:0}: Error finding container 6fc902553d074fe953ef5bdcfe734ef2ab4844994febd0c81599889db02da731: Status 404 returned error can't find the container with id 6fc902553d074fe953ef5bdcfe734ef2ab4844994febd0c81599889db02da731 Jul 20 16:20:03.410139 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.410060 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" event={"ID":"bd9741b9-0a1b-4beb-a201-48d81e62cee4","Type":"ContainerStarted","Data":"74f91a878ef63dfcec390e22c3df5466489b43c0592f3c969d94817065ea0d87"} Jul 20 16:20:03.411384 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.411360 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" event={"ID":"163a41e5-766b-4137-b6d5-07229d0df573","Type":"ContainerStarted","Data":"6fc902553d074fe953ef5bdcfe734ef2ab4844994febd0c81599889db02da731"} Jul 20 16:20:03.510042 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.510018 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sp6tb"] Jul 20 16:20:03.514403 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.514383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:03.516973 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.516957 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-x587s\"" Jul 20 16:20:03.517058 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.517013 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 16:20:03.523361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.523319 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sp6tb"] Jul 20 16:20:03.645372 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.645344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9q6\" (UniqueName: \"kubernetes.io/projected/21d4efeb-b47e-43fd-9ede-c7194b00f91b-kube-api-access-pr9q6\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:03.645546 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.645382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d4efeb-b47e-43fd-9ede-c7194b00f91b-tls-certs\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:03.709988 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.709919 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mlchg"] Jul 20 16:20:03.713131 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.713114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.715537 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.715518 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 16:20:03.715805 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.715785 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 16:20:03.715926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.715786 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 16:20:03.715926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.715803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qd7x5\"" Jul 20 16:20:03.715926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.715881 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 16:20:03.725899 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.725875 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mlchg"] Jul 20 16:20:03.746634 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.746599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9q6\" (UniqueName: \"kubernetes.io/projected/21d4efeb-b47e-43fd-9ede-c7194b00f91b-kube-api-access-pr9q6\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:03.746727 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.746647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d4efeb-b47e-43fd-9ede-c7194b00f91b-tls-certs\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:03.746800 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:03.746782 2575 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 20 16:20:03.746850 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:03.746840 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21d4efeb-b47e-43fd-9ede-c7194b00f91b-tls-certs podName:21d4efeb-b47e-43fd-9ede-c7194b00f91b nodeName:}" failed. No retries permitted until 2026-07-20 16:20:04.246824641 +0000 UTC m=+381.403641906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/21d4efeb-b47e-43fd-9ede-c7194b00f91b-tls-certs") pod "model-serving-api-54d89bd5fc-sp6tb" (UID: "21d4efeb-b47e-43fd-9ede-c7194b00f91b") : secret "model-serving-api-tls" not found Jul 20 16:20:03.758497 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.758475 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9q6\" (UniqueName: \"kubernetes.io/projected/21d4efeb-b47e-43fd-9ede-c7194b00f91b-kube-api-access-pr9q6\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:03.847768 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/341d3ec9-cace-4792-acde-dabbcdecad3d-local-certs\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.847883 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.847883 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-token\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.847992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.847992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzvr\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-kube-api-access-bnzvr\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.847992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-cacerts\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.847992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.847982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949037 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/341d3ec9-cace-4792-acde-dabbcdecad3d-local-certs\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-token\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzvr\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-kube-api-access-bnzvr\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-cacerts\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.949463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.949266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.950137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.950115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.951886 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.951713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/341d3ec9-cace-4792-acde-dabbcdecad3d-local-certs\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.952099 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.952062 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.952214 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.952192 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-cacerts\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.952557 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.952534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.957334 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.957310 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-token\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:03.957851 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:03.957834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzvr\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-kube-api-access-bnzvr\") pod \"istiod-openshift-gateway-7574459656-mlchg\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:04.022537 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.022500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:04.185988 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.185960 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mlchg"] Jul 20 16:20:04.186530 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:20:04.186507 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341d3ec9_cace_4792_acde_dabbcdecad3d.slice/crio-0dcf865817948bbaa3f28884b95443ec5292b9e631a653b2edf2c48982dcbbd0 WatchSource:0}: Error finding container 0dcf865817948bbaa3f28884b95443ec5292b9e631a653b2edf2c48982dcbbd0: Status 404 returned error can't find the container with id 0dcf865817948bbaa3f28884b95443ec5292b9e631a653b2edf2c48982dcbbd0 Jul 20 16:20:04.251991 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.251956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d4efeb-b47e-43fd-9ede-c7194b00f91b-tls-certs\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:04.254209 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.254185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21d4efeb-b47e-43fd-9ede-c7194b00f91b-tls-certs\") pod \"model-serving-api-54d89bd5fc-sp6tb\" (UID: \"21d4efeb-b47e-43fd-9ede-c7194b00f91b\") " pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:04.418203 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.418114 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" event={"ID":"341d3ec9-cace-4792-acde-dabbcdecad3d","Type":"ContainerStarted","Data":"0dcf865817948bbaa3f28884b95443ec5292b9e631a653b2edf2c48982dcbbd0"} Jul 20 16:20:04.426524 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.426497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:04.602590 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.602565 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sp6tb"] Jul 20 16:20:04.816667 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.816591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:04.918514 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:04.918481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:05.425157 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:05.425116 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" event={"ID":"21d4efeb-b47e-43fd-9ede-c7194b00f91b","Type":"ContainerStarted","Data":"55c15dc545d5e439c54fa00184e3ebde308e35ce16548dc33dddc182f4876d9e"} Jul 20 16:20:08.610242 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:08.610207 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:20:08.610609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:08.610270 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:20:09.445782 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.445732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" event={"ID":"bd9741b9-0a1b-4beb-a201-48d81e62cee4","Type":"ContainerStarted","Data":"a3d005d856c3c1cd2a59bfea08819fa5e87ee03ecf6da7268e954cffd6787cff"} Jul 20 16:20:09.447224 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.447196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" event={"ID":"163a41e5-766b-4137-b6d5-07229d0df573","Type":"ContainerStarted","Data":"c6e617004383e3ef7a51f7bd9fa154434933b120930fbb35c2f4a22f20d4ed33"} Jul 20 16:20:09.447380 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.447284 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:09.448695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.448663 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" event={"ID":"21d4efeb-b47e-43fd-9ede-c7194b00f91b","Type":"ContainerStarted","Data":"1d20874acdf841791ddac170e15f83a60794e8a71020f7b3142c81f19c64ca98"} Jul 20 16:20:09.448807 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.448715 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:09.450095 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.450074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" event={"ID":"341d3ec9-cace-4792-acde-dabbcdecad3d","Type":"ContainerStarted","Data":"c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974"} Jul 20 16:20:09.450175 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.450120 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:09.451927 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.451904 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mlchg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 16:20:09.452008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.451956 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:20:09.465749 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.465703 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b4f98b7bc-bmbcs" podStartSLOduration=1.9296466639999998 podStartE2EDuration="7.465687626s" totalImagesPullingTime="5.536040962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:09.463879682 +0000 UTC m=+386.620696998" watchObservedRunningTime="2026-07-20 16:20:09.465687626 +0000 UTC m=+386.622504915" Jul 20 16:20:09.482260 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.482218 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" podStartSLOduration=2.154693802 podStartE2EDuration="7.482202351s" totalImagesPullingTime="5.327508549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:09.481057762 +0000 UTC m=+386.637875051" watchObservedRunningTime="2026-07-20 16:20:09.482202351 +0000 UTC m=+386.639019639" Jul 20 16:20:09.501784 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.501742 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" podStartSLOduration=2.080087356 podStartE2EDuration="6.501725638s" totalImagesPullingTime="4.421638282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:09.499504019 +0000 UTC m=+386.656321307" watchObservedRunningTime="2026-07-20 16:20:09.501725638 +0000 UTC m=+386.658542926" Jul 20 16:20:09.516151 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.516100 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" podStartSLOduration=2.474837385 podStartE2EDuration="6.51608898s" totalImagesPullingTime="4.041251595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:09.515266717 +0000 UTC m=+386.672084008" watchObservedRunningTime="2026-07-20 16:20:09.51608898 +0000 UTC m=+386.672906266" Jul 20 16:20:09.787668 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.787610 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:09.913286 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:09.913240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:10.454897 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:10.454866 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mlchg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 16:20:10.455083 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:10.454923 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:20:11.864356 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:11.864321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:11.969872 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:11.969838 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:12.843852 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.843800 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:12.860631 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.860592 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pd46p"] Jul 20 16:20:12.864583 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.864563 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:12.869264 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.869242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mwxqq\"" Jul 20 16:20:12.869374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.869247 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 20 16:20:12.871635 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.871471 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w"] Jul 20 16:20:12.875034 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.875015 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pd46p"] Jul 20 16:20:12.875165 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.875111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:12.877823 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.877804 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-r9vpt\"" Jul 20 16:20:12.877932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.877897 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 20 16:20:12.885922 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.885894 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w"] Jul 20 16:20:12.916070 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.916045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:12.928172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.928151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-cert\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:12.928284 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:12.928191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxqh\" (UniqueName: \"kubernetes.io/projected/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-kube-api-access-npxqh\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.029563 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.029537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk7ss\" (UniqueName: \"kubernetes.io/projected/736da8cc-e301-4dfe-a834-67694c9e831a-kube-api-access-zk7ss\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.029732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.029606 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-cert\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.029732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.029647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736da8cc-e301-4dfe-a834-67694c9e831a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.029732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.029678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxqh\" (UniqueName: \"kubernetes.io/projected/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-kube-api-access-npxqh\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.029732 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:13.029708 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 20 16:20:13.029897 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:13.029777 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-cert podName:99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0 nodeName:}" failed. No retries permitted until 2026-07-20 16:20:13.529759405 +0000 UTC m=+390.686576673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-cert") pod "kserve-controller-manager-d6f4b65b8-pd46p" (UID: "99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0") : secret "kserve-webhook-server-cert" not found Jul 20 16:20:13.045028 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.044997 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxqh\" (UniqueName: \"kubernetes.io/projected/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-kube-api-access-npxqh\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.130902 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.130812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736da8cc-e301-4dfe-a834-67694c9e831a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.131059 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.130914 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk7ss\" (UniqueName: \"kubernetes.io/projected/736da8cc-e301-4dfe-a834-67694c9e831a-kube-api-access-zk7ss\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.131225 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:13.131201 2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 20 16:20:13.131300 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:13.131286 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736da8cc-e301-4dfe-a834-67694c9e831a-cert podName:736da8cc-e301-4dfe-a834-67694c9e831a nodeName:}" failed. No retries permitted until 2026-07-20 16:20:13.631263515 +0000 UTC m=+390.788080799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/736da8cc-e301-4dfe-a834-67694c9e831a-cert") pod "llmisvc-controller-manager-777c6bd7d5-crd2w" (UID: "736da8cc-e301-4dfe-a834-67694c9e831a") : secret "llmisvc-webhook-server-cert" not found Jul 20 16:20:13.146154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.146117 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk7ss\" (UniqueName: \"kubernetes.io/projected/736da8cc-e301-4dfe-a834-67694c9e831a-kube-api-access-zk7ss\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.250402 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.250363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:13.384843 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.384765 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:13.455450 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.455428 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:13.534996 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.534961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-cert\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.537398 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.537369 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0-cert\") pod \"kserve-controller-manager-d6f4b65b8-pd46p\" (UID: \"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.636282 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.636211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736da8cc-e301-4dfe-a834-67694c9e831a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.638566 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.638537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/736da8cc-e301-4dfe-a834-67694c9e831a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crd2w\" (UID: \"736da8cc-e301-4dfe-a834-67694c9e831a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.778884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.778855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:13.789188 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.789167 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:13.947935 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.947902 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pd46p"] Jul 20 16:20:13.951432 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:20:13.951404 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e2bd0c_c6fd_4bbd_8e4a_96d8043dfbd0.slice/crio-5674165ab502193f723a87cb8dfcd815f8e7f48fb509557a698ca0e372207e7b WatchSource:0}: Error finding container 5674165ab502193f723a87cb8dfcd815f8e7f48fb509557a698ca0e372207e7b: Status 404 returned error can't find the container with id 5674165ab502193f723a87cb8dfcd815f8e7f48fb509557a698ca0e372207e7b Jul 20 16:20:13.970246 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:13.970221 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w"] Jul 20 16:20:13.972898 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:20:13.972874 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod736da8cc_e301_4dfe_a834_67694c9e831a.slice/crio-ffaae4c9290b9c24c68bcf0325d5140a3900dc0852f42afcb76d4bd725f9d60a WatchSource:0}: Error finding container ffaae4c9290b9c24c68bcf0325d5140a3900dc0852f42afcb76d4bd725f9d60a: Status 404 returned error can't find the container with id ffaae4c9290b9c24c68bcf0325d5140a3900dc0852f42afcb76d4bd725f9d60a Jul 20 16:20:14.130120 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.130087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:14.271176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.271141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:20:14.456932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.456903 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mlchg"] Jul 20 16:20:14.457125 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.457083 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerName="discovery" containerID="cri-o://c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974" gracePeriod=30 Jul 20 16:20:14.476544 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.476391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" event={"ID":"736da8cc-e301-4dfe-a834-67694c9e831a","Type":"ContainerStarted","Data":"ffaae4c9290b9c24c68bcf0325d5140a3900dc0852f42afcb76d4bd725f9d60a"} Jul 20 16:20:14.477862 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.477839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" event={"ID":"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0","Type":"ContainerStarted","Data":"5674165ab502193f723a87cb8dfcd815f8e7f48fb509557a698ca0e372207e7b"} Jul 20 16:20:14.720216 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.720195 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:14.847957 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.847879 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-token\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.847957 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.847920 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-kubeconfig\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.848159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.847962 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnzvr\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-kube-api-access-bnzvr\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.848159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.848025 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/341d3ec9-cace-4792-acde-dabbcdecad3d-local-certs\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.848159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.848057 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-dns-cert\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.848159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.848113 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-cacerts\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.848159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.848144 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-ca-configmap\") pod \"341d3ec9-cace-4792-acde-dabbcdecad3d\" (UID: \"341d3ec9-cace-4792-acde-dabbcdecad3d\") " Jul 20 16:20:14.848834 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.848800 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:20:14.850743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.850572 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:20:14.850743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.850734 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:20:14.850894 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.850788 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-cacerts" (OuterVolumeSpecName: "cacerts") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:20:14.850894 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.850840 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:20:14.850967 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.850908 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-kube-api-access-bnzvr" (OuterVolumeSpecName: "kube-api-access-bnzvr") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "kube-api-access-bnzvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:20:14.851145 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.851130 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/341d3ec9-cace-4792-acde-dabbcdecad3d-local-certs" (OuterVolumeSpecName: "local-certs") pod "341d3ec9-cace-4792-acde-dabbcdecad3d" (UID: "341d3ec9-cace-4792-acde-dabbcdecad3d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:14.949797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949761 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:14.949797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949799 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-kubeconfig\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:14.950172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949826 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnzvr\" (UniqueName: \"kubernetes.io/projected/341d3ec9-cace-4792-acde-dabbcdecad3d-kube-api-access-bnzvr\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:14.950172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949841 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/341d3ec9-cace-4792-acde-dabbcdecad3d-local-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:14.950172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949850 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-dns-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:14.950172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949859 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/341d3ec9-cace-4792-acde-dabbcdecad3d-cacerts\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:14.950172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:14.949870 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/341d3ec9-cace-4792-acde-dabbcdecad3d-istio-csr-ca-configmap\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:20:15.485389 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.485338 2575 generic.go:356] "Generic (PLEG): container finished" podID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerID="c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974" exitCode=0 Jul 20 16:20:15.485546 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.485459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" event={"ID":"341d3ec9-cace-4792-acde-dabbcdecad3d","Type":"ContainerDied","Data":"c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974"} Jul 20 16:20:15.485611 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.485546 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" event={"ID":"341d3ec9-cace-4792-acde-dabbcdecad3d","Type":"ContainerDied","Data":"0dcf865817948bbaa3f28884b95443ec5292b9e631a653b2edf2c48982dcbbd0"} Jul 20 16:20:15.485611 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.485593 2575 scope.go:117] "RemoveContainer" containerID="c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974" Jul 20 16:20:15.487637 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.485824 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mlchg" Jul 20 16:20:15.511145 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.511118 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mlchg"] Jul 20 16:20:15.514594 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.514569 2575 scope.go:117] "RemoveContainer" containerID="c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974" Jul 20 16:20:15.514947 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:20:15.514919 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974\": container with ID starting with c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974 not found: ID does not exist" containerID="c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974" Jul 20 16:20:15.515045 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.514955 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974"} err="failed to get container status \"c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974\": rpc error: code = NotFound desc = could not find container \"c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974\": container with ID starting with c47f9a730cf6fce6f1aac9b3f36d11cf736fc24092c4b6c5059419548a894974 not found: ID does not exist" Jul 20 16:20:15.517292 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.517271 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mlchg"] Jul 20 16:20:15.602884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:15.602855 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" path="/var/lib/kubelet/pods/341d3ec9-cace-4792-acde-dabbcdecad3d/volumes" Jul 20 16:20:18.501715 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:18.501682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" event={"ID":"736da8cc-e301-4dfe-a834-67694c9e831a","Type":"ContainerStarted","Data":"bf1638f4f500b3cca86c2838deb389679bef184a21a419223d6e6393ece7fd42"} Jul 20 16:20:18.502126 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:18.501767 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:18.503178 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:18.503159 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" event={"ID":"99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0","Type":"ContainerStarted","Data":"bb88c0cf6723a181a7d7f9e816f32e142737f5e275d5742e399475c4883cc3cf"} Jul 20 16:20:18.503265 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:18.503199 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:20:18.520092 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:18.520054 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" podStartSLOduration=3.045246725 podStartE2EDuration="6.520041578s" totalImagesPullingTime="3.474794853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:18.518018022 +0000 UTC m=+395.674835309" watchObservedRunningTime="2026-07-20 16:20:18.520041578 +0000 UTC m=+395.676858865" Jul 20 16:20:18.533763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:18.533722 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" podStartSLOduration=3.041685314 podStartE2EDuration="6.53371145s" totalImagesPullingTime="3.492026136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:18.533230498 +0000 UTC m=+395.690047785" watchObservedRunningTime="2026-07-20 16:20:18.53371145 +0000 UTC m=+395.690528766" Jul 20 16:20:20.457294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:20.457264 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-cj7ch" Jul 20 16:20:20.459254 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:20.459234 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sp6tb" Jul 20 16:20:49.510232 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:49.510202 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crd2w" Jul 20 16:20:49.513160 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:20:49.513142 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pd46p" Jul 20 16:21:01.741171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:01.741135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:01.874209 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:01.874168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:03.445307 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.445273 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:03.485873 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.485845 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q9nwq"] Jul 20 16:21:03.486171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.486159 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerName="discovery" Jul 20 16:21:03.486212 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.486172 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerName="discovery" Jul 20 16:21:03.486248 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.486230 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="341d3ec9-cace-4792-acde-dabbcdecad3d" containerName="discovery" Jul 20 16:21:03.495527 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.495498 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:03.497375 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.497332 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q9nwq"] Jul 20 16:21:03.498370 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.498345 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 16:21:03.498492 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.498347 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-tqk8b\"" Jul 20 16:21:03.499746 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.499724 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 16:21:03.516389 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.516363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:03.587743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.587720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:03.609612 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.609589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdv7x\" (UniqueName: \"kubernetes.io/projected/25b85661-da16-4ab4-9444-135c9cce6985-kube-api-access-hdv7x\") pod \"kuadrant-operator-catalog-q9nwq\" (UID: \"25b85661-da16-4ab4-9444-135c9cce6985\") " pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:03.710639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.710555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdv7x\" (UniqueName: \"kubernetes.io/projected/25b85661-da16-4ab4-9444-135c9cce6985-kube-api-access-hdv7x\") pod \"kuadrant-operator-catalog-q9nwq\" (UID: \"25b85661-da16-4ab4-9444-135c9cce6985\") " pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:03.718355 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.718328 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdv7x\" (UniqueName: \"kubernetes.io/projected/25b85661-da16-4ab4-9444-135c9cce6985-kube-api-access-hdv7x\") pod \"kuadrant-operator-catalog-q9nwq\" (UID: \"25b85661-da16-4ab4-9444-135c9cce6985\") " pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:03.806370 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.806346 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:03.966055 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:03.966031 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q9nwq"] Jul 20 16:21:03.967956 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:21:03.967916 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b85661_da16_4ab4_9444_135c9cce6985.slice/crio-361f17e39df27dc8a12ba7c3c1de5d51462d537b7e54c695d0c259a1e07f18cc WatchSource:0}: Error finding container 361f17e39df27dc8a12ba7c3c1de5d51462d537b7e54c695d0c259a1e07f18cc: Status 404 returned error can't find the container with id 361f17e39df27dc8a12ba7c3c1de5d51462d537b7e54c695d0c259a1e07f18cc Jul 20 16:21:04.049256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.049231 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q9nwq"] Jul 20 16:21:04.069600 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.069570 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kglvl"] Jul 20 16:21:04.074017 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.073998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:04.082697 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.082674 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kglvl"] Jul 20 16:21:04.114107 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.114084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2dxm\" (UniqueName: \"kubernetes.io/projected/b480e33b-e5ac-4599-ad51-37a7f250b1e2-kube-api-access-b2dxm\") pod \"kuadrant-operator-catalog-kglvl\" (UID: \"b480e33b-e5ac-4599-ad51-37a7f250b1e2\") " pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:04.215076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.215002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2dxm\" (UniqueName: \"kubernetes.io/projected/b480e33b-e5ac-4599-ad51-37a7f250b1e2-kube-api-access-b2dxm\") pod \"kuadrant-operator-catalog-kglvl\" (UID: \"b480e33b-e5ac-4599-ad51-37a7f250b1e2\") " pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:04.222760 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.222732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2dxm\" (UniqueName: \"kubernetes.io/projected/b480e33b-e5ac-4599-ad51-37a7f250b1e2-kube-api-access-b2dxm\") pod \"kuadrant-operator-catalog-kglvl\" (UID: \"b480e33b-e5ac-4599-ad51-37a7f250b1e2\") " pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:04.389923 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.389885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:04.516821 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.516651 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kglvl"] Jul 20 16:21:04.518835 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:21:04.518810 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb480e33b_e5ac_4599_ad51_37a7f250b1e2.slice/crio-e2c9dfa6cef24f056da57f692d8b3af5aef5ff5c00348040ba0aa7b003c2f045 WatchSource:0}: Error finding container e2c9dfa6cef24f056da57f692d8b3af5aef5ff5c00348040ba0aa7b003c2f045: Status 404 returned error can't find the container with id e2c9dfa6cef24f056da57f692d8b3af5aef5ff5c00348040ba0aa7b003c2f045 Jul 20 16:21:04.706403 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.706365 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" event={"ID":"b480e33b-e5ac-4599-ad51-37a7f250b1e2","Type":"ContainerStarted","Data":"e2c9dfa6cef24f056da57f692d8b3af5aef5ff5c00348040ba0aa7b003c2f045"} Jul 20 16:21:04.707418 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:04.707394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" event={"ID":"25b85661-da16-4ab4-9444-135c9cce6985","Type":"ContainerStarted","Data":"361f17e39df27dc8a12ba7c3c1de5d51462d537b7e54c695d0c259a1e07f18cc"} Jul 20 16:21:06.718890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:06.718805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" event={"ID":"b480e33b-e5ac-4599-ad51-37a7f250b1e2","Type":"ContainerStarted","Data":"8f5ab489e27675306bf42abdc910efbf7c03987cb30f4eb20b68e19389cd1eee"} Jul 20 16:21:06.720172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:06.720145 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" event={"ID":"25b85661-da16-4ab4-9444-135c9cce6985","Type":"ContainerStarted","Data":"17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0"} Jul 20 16:21:06.720295 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:06.720160 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" podUID="25b85661-da16-4ab4-9444-135c9cce6985" containerName="registry-server" containerID="cri-o://17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0" gracePeriod=2 Jul 20 16:21:06.737498 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:06.737456 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" podStartSLOduration=0.882438224 podStartE2EDuration="2.737442348s" totalImagesPullingTime="1.855004124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:21:06.736041083 +0000 UTC m=+443.892858370" watchObservedRunningTime="2026-07-20 16:21:06.737442348 +0000 UTC m=+443.894259640" Jul 20 16:21:06.753317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:06.753273 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" podStartSLOduration=1.350252988 podStartE2EDuration="3.753259398s" totalImagesPullingTime="2.40300641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:21:06.7520428 +0000 UTC m=+443.908860089" watchObservedRunningTime="2026-07-20 16:21:06.753259398 +0000 UTC m=+443.910076684" Jul 20 16:21:06.969101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:06.969044 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:07.043087 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.043056 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdv7x\" (UniqueName: \"kubernetes.io/projected/25b85661-da16-4ab4-9444-135c9cce6985-kube-api-access-hdv7x\") pod \"25b85661-da16-4ab4-9444-135c9cce6985\" (UID: \"25b85661-da16-4ab4-9444-135c9cce6985\") " Jul 20 16:21:07.045145 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.045117 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b85661-da16-4ab4-9444-135c9cce6985-kube-api-access-hdv7x" (OuterVolumeSpecName: "kube-api-access-hdv7x") pod "25b85661-da16-4ab4-9444-135c9cce6985" (UID: "25b85661-da16-4ab4-9444-135c9cce6985"). InnerVolumeSpecName "kube-api-access-hdv7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:21:07.143933 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.143897 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdv7x\" (UniqueName: \"kubernetes.io/projected/25b85661-da16-4ab4-9444-135c9cce6985-kube-api-access-hdv7x\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:21:07.726156 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.726069 2575 generic.go:356] "Generic (PLEG): container finished" podID="25b85661-da16-4ab4-9444-135c9cce6985" containerID="17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0" exitCode=0 Jul 20 16:21:07.726156 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.726110 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" Jul 20 16:21:07.726156 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.726149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" event={"ID":"25b85661-da16-4ab4-9444-135c9cce6985","Type":"ContainerDied","Data":"17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0"} Jul 20 16:21:07.726696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.726198 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q9nwq" event={"ID":"25b85661-da16-4ab4-9444-135c9cce6985","Type":"ContainerDied","Data":"361f17e39df27dc8a12ba7c3c1de5d51462d537b7e54c695d0c259a1e07f18cc"} Jul 20 16:21:07.726696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.726225 2575 scope.go:117] "RemoveContainer" containerID="17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0" Jul 20 16:21:07.734962 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.734945 2575 scope.go:117] "RemoveContainer" containerID="17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0" Jul 20 16:21:07.735206 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:21:07.735183 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0\": container with ID starting with 17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0 not found: ID does not exist" containerID="17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0" Jul 20 16:21:07.735326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.735211 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0"} err="failed to get container status \"17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0\": rpc error: code = NotFound desc = could not find container \"17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0\": container with ID starting with 17b262c078ec3c6d85f0e352a28e8390857632593391b288b23bda4a2b1672b0 not found: ID does not exist" Jul 20 16:21:07.742433 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.742411 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q9nwq"] Jul 20 16:21:07.745975 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:07.745956 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q9nwq"] Jul 20 16:21:09.602097 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:09.602063 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b85661-da16-4ab4-9444-135c9cce6985" path="/var/lib/kubelet/pods/25b85661-da16-4ab4-9444-135c9cce6985/volumes" Jul 20 16:21:14.390174 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:14.390142 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:14.390579 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:14.390243 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:14.413884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:14.413849 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:14.778256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:14.778224 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kglvl" Jul 20 16:21:30.930592 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:30.930553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:34.107525 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.107492 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w"] Jul 20 16:21:34.107979 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.107838 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b85661-da16-4ab4-9444-135c9cce6985" containerName="registry-server" Jul 20 16:21:34.107979 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.107849 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b85661-da16-4ab4-9444-135c9cce6985" containerName="registry-server" Jul 20 16:21:34.107979 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.107900 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b85661-da16-4ab4-9444-135c9cce6985" containerName="registry-server" Jul 20 16:21:34.113755 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.113738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:34.116464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.116442 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fxx5n\"" Jul 20 16:21:34.126733 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.126704 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w"] Jul 20 16:21:34.247914 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.247880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng48q\" (UniqueName: \"kubernetes.io/projected/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4-kube-api-access-ng48q\") pod \"limitador-operator-controller-manager-859d7b78bd-hph8w\" (UID: \"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:34.348677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.348646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng48q\" (UniqueName: \"kubernetes.io/projected/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4-kube-api-access-ng48q\") pod \"limitador-operator-controller-manager-859d7b78bd-hph8w\" (UID: \"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:34.357244 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.357212 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng48q\" (UniqueName: \"kubernetes.io/projected/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4-kube-api-access-ng48q\") pod \"limitador-operator-controller-manager-859d7b78bd-hph8w\" (UID: \"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:34.426004 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.425944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:34.554326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.554292 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w"] Jul 20 16:21:34.557271 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:21:34.557233 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f7dfc0_7fbd_4cba_8809_a1b0bef07ef4.slice/crio-264859e52c023db69c6ab63b32fa69a96504be0578878d526ff69b1ca280e94f WatchSource:0}: Error finding container 264859e52c023db69c6ab63b32fa69a96504be0578878d526ff69b1ca280e94f: Status 404 returned error can't find the container with id 264859e52c023db69c6ab63b32fa69a96504be0578878d526ff69b1ca280e94f Jul 20 16:21:34.842249 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:34.842211 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" event={"ID":"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4","Type":"ContainerStarted","Data":"264859e52c023db69c6ab63b32fa69a96504be0578878d526ff69b1ca280e94f"} Jul 20 16:21:35.072346 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:35.072312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:36.855462 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:36.855427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" event={"ID":"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4","Type":"ContainerStarted","Data":"fceaf5cec368acc4d7cbc828cf75b05a41a74da40d222d1054f2234e424b4d39"} Jul 20 16:21:36.855871 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:36.855559 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:36.874150 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:36.874107 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" podStartSLOduration=0.756579332 podStartE2EDuration="2.874093285s" totalImagesPullingTime="2.117513953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:21:36.873174659 +0000 UTC m=+474.029991957" watchObservedRunningTime="2026-07-20 16:21:36.874093285 +0000 UTC m=+474.030910572" Jul 20 16:21:40.528865 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.528829 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv"] Jul 20 16:21:40.533037 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.533008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.538694 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.538666 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n542q\"" Jul 20 16:21:40.548174 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.548150 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv"] Jul 20 16:21:40.699119 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.699083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h57r4\" (UniqueName: \"kubernetes.io/projected/cb1ca055-24a7-4480-9796-574642164037-kube-api-access-h57r4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.699294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.699183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb1ca055-24a7-4480-9796-574642164037-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.800456 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.800387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h57r4\" (UniqueName: \"kubernetes.io/projected/cb1ca055-24a7-4480-9796-574642164037-kube-api-access-h57r4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.800583 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.800516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb1ca055-24a7-4480-9796-574642164037-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.800855 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.800839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb1ca055-24a7-4480-9796-574642164037-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.811331 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.811300 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h57r4\" (UniqueName: \"kubernetes.io/projected/cb1ca055-24a7-4480-9796-574642164037-kube-api-access-h57r4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.844288 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.844266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:40.977839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:40.977811 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv"] Jul 20 16:21:40.981251 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:21:40.981227 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1ca055_24a7_4480_9796_574642164037.slice/crio-ef0bdc7df6ee904c9db516fecdb54014029c81545f24ecf63fecf73203f762de WatchSource:0}: Error finding container ef0bdc7df6ee904c9db516fecdb54014029c81545f24ecf63fecf73203f762de: Status 404 returned error can't find the container with id ef0bdc7df6ee904c9db516fecdb54014029c81545f24ecf63fecf73203f762de Jul 20 16:21:41.388482 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:41.388446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:41.706218 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:41.706136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:41.878790 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:41.878755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" event={"ID":"cb1ca055-24a7-4480-9796-574642164037","Type":"ContainerStarted","Data":"ef0bdc7df6ee904c9db516fecdb54014029c81545f24ecf63fecf73203f762de"} Jul 20 16:21:43.405933 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:43.405900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:44.025495 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.025460 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q"] Jul 20 16:21:44.030289 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.030270 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:44.035970 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.035945 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 16:21:44.036090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.036009 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sgb9h\"" Jul 20 16:21:44.042505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.042484 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q"] Jul 20 16:21:44.123230 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.123205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhxpm\" (UniqueName: \"kubernetes.io/projected/96ef6888-57ad-4078-b57c-aaa865053b84-kube-api-access-rhxpm\") pod \"dns-operator-controller-manager-864dd78c4c-zc67q\" (UID: \"96ef6888-57ad-4078-b57c-aaa865053b84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:44.229165 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.224874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhxpm\" (UniqueName: \"kubernetes.io/projected/96ef6888-57ad-4078-b57c-aaa865053b84-kube-api-access-rhxpm\") pod \"dns-operator-controller-manager-864dd78c4c-zc67q\" (UID: \"96ef6888-57ad-4078-b57c-aaa865053b84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:44.233552 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.233528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhxpm\" (UniqueName: \"kubernetes.io/projected/96ef6888-57ad-4078-b57c-aaa865053b84-kube-api-access-rhxpm\") pod \"dns-operator-controller-manager-864dd78c4c-zc67q\" (UID: \"96ef6888-57ad-4078-b57c-aaa865053b84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:44.340190 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.340131 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:44.480402 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.480374 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q"] Jul 20 16:21:44.483673 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:21:44.483642 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ef6888_57ad_4078_b57c_aaa865053b84.slice/crio-dd6e6a3ce8a13243d3d94cb9e9ff1feb3b9225ec6bce57028607705ab0a27378 WatchSource:0}: Error finding container dd6e6a3ce8a13243d3d94cb9e9ff1feb3b9225ec6bce57028607705ab0a27378: Status 404 returned error can't find the container with id dd6e6a3ce8a13243d3d94cb9e9ff1feb3b9225ec6bce57028607705ab0a27378 Jul 20 16:21:44.876441 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.876390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:44.893242 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:44.893214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" event={"ID":"96ef6888-57ad-4078-b57c-aaa865053b84","Type":"ContainerStarted","Data":"dd6e6a3ce8a13243d3d94cb9e9ff1feb3b9225ec6bce57028607705ab0a27378"} Jul 20 16:21:45.737918 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:45.737874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:46.502041 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:46.502009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:46.600207 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:46.600167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:46.904932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:46.904892 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" event={"ID":"96ef6888-57ad-4078-b57c-aaa865053b84","Type":"ContainerStarted","Data":"85c850fc7bef720c143237475984b467ab78e213e24ad8d50f58eb925fd56174"} Jul 20 16:21:46.905378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:46.905010 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:46.922530 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:46.922488 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" podStartSLOduration=1.037654242 podStartE2EDuration="2.922475157s" totalImagesPullingTime="1.884820915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:21:46.920587063 +0000 UTC m=+484.077404361" watchObservedRunningTime="2026-07-20 16:21:46.922475157 +0000 UTC m=+484.079292444" Jul 20 16:21:47.862176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:47.862148 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:21:48.915860 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:48.915828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" event={"ID":"cb1ca055-24a7-4480-9796-574642164037","Type":"ContainerStarted","Data":"61a962ceedab1ab28e5d8d03855d1b47eef6606f9d2e8bd36316ab8289d26566"} Jul 20 16:21:48.916274 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:48.915984 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:21:48.947776 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:48.947728 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" podStartSLOduration=1.9733656210000001 podStartE2EDuration="8.947705754s" totalImagesPullingTime="6.974340133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:21:48.94529215 +0000 UTC m=+486.102109437" watchObservedRunningTime="2026-07-20 16:21:48.947705754 +0000 UTC m=+486.104523041" Jul 20 16:21:49.390598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.390557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:49.422795 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.422771 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf"] Jul 20 16:21:49.426446 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.426428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:21:49.431836 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.431803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nnq8n\"" Jul 20 16:21:49.440263 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.440244 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf"] Jul 20 16:21:49.574032 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.574000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-984pz\" (UniqueName: \"kubernetes.io/projected/bb4cc956-9371-4427-87a1-dff44b8836d1-kube-api-access-984pz\") pod \"authorino-operator-75cc8d5cb7-n8vlf\" (UID: \"bb4cc956-9371-4427-87a1-dff44b8836d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:21:49.674927 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.674846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-984pz\" (UniqueName: \"kubernetes.io/projected/bb4cc956-9371-4427-87a1-dff44b8836d1-kube-api-access-984pz\") pod \"authorino-operator-75cc8d5cb7-n8vlf\" (UID: \"bb4cc956-9371-4427-87a1-dff44b8836d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:21:49.686172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.686144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-984pz\" (UniqueName: \"kubernetes.io/projected/bb4cc956-9371-4427-87a1-dff44b8836d1-kube-api-access-984pz\") pod \"authorino-operator-75cc8d5cb7-n8vlf\" (UID: \"bb4cc956-9371-4427-87a1-dff44b8836d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:21:49.736264 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.736238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:21:49.870636 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.870587 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf"] Jul 20 16:21:49.874162 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:21:49.874134 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4cc956_9371_4427_87a1_dff44b8836d1.slice/crio-843ee89c9d692c8da808b63c4d9cc4e8bfa613cc1a4a3bd22dd0160f171006c0 WatchSource:0}: Error finding container 843ee89c9d692c8da808b63c4d9cc4e8bfa613cc1a4a3bd22dd0160f171006c0: Status 404 returned error can't find the container with id 843ee89c9d692c8da808b63c4d9cc4e8bfa613cc1a4a3bd22dd0160f171006c0 Jul 20 16:21:49.921310 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:49.921283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" event={"ID":"bb4cc956-9371-4427-87a1-dff44b8836d1","Type":"ContainerStarted","Data":"843ee89c9d692c8da808b63c4d9cc4e8bfa613cc1a4a3bd22dd0160f171006c0"} Jul 20 16:21:50.655990 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:50.655953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:51.205334 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:51.205295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:52.675957 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:52.675882 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:52.776652 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:52.776595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:52.940932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:52.940860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" event={"ID":"bb4cc956-9371-4427-87a1-dff44b8836d1","Type":"ContainerStarted","Data":"636bf3a396ad595a83b4ece50eb6fa3f821c27583413c2c6406cfbedea7998dd"} Jul 20 16:21:52.941077 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:52.940987 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:21:52.958381 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:52.958338 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" podStartSLOduration=1.5682623869999999 podStartE2EDuration="3.958324697s" totalImagesPullingTime="2.39006231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:21:52.957728023 +0000 UTC m=+490.114545311" watchObservedRunningTime="2026-07-20 16:21:52.958324697 +0000 UTC m=+490.115141983" Jul 20 16:21:56.323941 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:56.323902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:56.392477 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:56.392445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:56.497392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:56.497361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:56.632360 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:56.632274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:56.705968 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:56.705943 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:57.240537 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:57.240497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:57.341903 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:57.341867 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:21:57.912290 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:57.912261 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zc67q" Jul 20 16:21:59.924402 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:21:59.924372 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:01.720395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.720365 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv"] Jul 20 16:22:01.720893 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.720635 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" podUID="cb1ca055-24a7-4480-9796-574642164037" containerName="manager" containerID="cri-o://61a962ceedab1ab28e5d8d03855d1b47eef6606f9d2e8bd36316ab8289d26566" gracePeriod=2 Jul 20 16:22:01.722221 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.722200 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv"] Jul 20 16:22:01.723301 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:01.723276 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:01.751980 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.751957 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp"] Jul 20 16:22:01.752357 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.752335 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb1ca055-24a7-4480-9796-574642164037" containerName="manager" Jul 20 16:22:01.752357 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.752352 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb1ca055-24a7-4480-9796-574642164037" containerName="manager" Jul 20 16:22:01.752457 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.752443 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb1ca055-24a7-4480-9796-574642164037" containerName="manager" Jul 20 16:22:01.755419 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.755403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.761802 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:01.761768 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:01.765147 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.765125 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w"] Jul 20 16:22:01.765362 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.765342 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" containerName="manager" containerID="cri-o://fceaf5cec368acc4d7cbc828cf75b05a41a74da40d222d1054f2234e424b4d39" gracePeriod=2 Jul 20 16:22:01.765958 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.765929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khhjb\" (UniqueName: \"kubernetes.io/projected/aeb55210-499d-4ab1-b3d4-a3b9fae11361-kube-api-access-khhjb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdhwp\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.766076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.766049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aeb55210-499d-4ab1-b3d4-a3b9fae11361-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdhwp\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.773733 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.773676 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp"] Jul 20 16:22:01.775754 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.775728 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w"] Jul 20 16:22:01.791222 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:01.791192 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:01.793569 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:01.793538 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:01.805661 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.805637 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2"] Jul 20 16:22:01.805978 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.805965 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" containerName="manager" Jul 20 16:22:01.805978 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.805977 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" containerName="manager" Jul 20 16:22:01.806092 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.806045 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" containerName="manager" Jul 20 16:22:01.808992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.808972 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:01.811647 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:01.811602 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:01.817750 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.817727 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2"] Jul 20 16:22:01.839459 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:01.839430 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:01.866609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.866586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aeb55210-499d-4ab1-b3d4-a3b9fae11361-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdhwp\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.866699 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.866627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xkrw\" (UniqueName: \"kubernetes.io/projected/cc1f0aab-36aa-4f1f-a028-008136cd1cd0-kube-api-access-6xkrw\") pod \"limitador-operator-controller-manager-859d7b78bd-pxph2\" (UID: \"cc1f0aab-36aa-4f1f-a028-008136cd1cd0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:01.866699 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.866686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khhjb\" (UniqueName: \"kubernetes.io/projected/aeb55210-499d-4ab1-b3d4-a3b9fae11361-kube-api-access-khhjb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdhwp\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.866904 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.866887 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aeb55210-499d-4ab1-b3d4-a3b9fae11361-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdhwp\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.875136 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.875114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khhjb\" (UniqueName: \"kubernetes.io/projected/aeb55210-499d-4ab1-b3d4-a3b9fae11361-kube-api-access-khhjb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hdhwp\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:01.967333 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.967303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xkrw\" (UniqueName: \"kubernetes.io/projected/cc1f0aab-36aa-4f1f-a028-008136cd1cd0-kube-api-access-6xkrw\") pod \"limitador-operator-controller-manager-859d7b78bd-pxph2\" (UID: \"cc1f0aab-36aa-4f1f-a028-008136cd1cd0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:01.975710 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.975649 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xkrw\" (UniqueName: \"kubernetes.io/projected/cc1f0aab-36aa-4f1f-a028-008136cd1cd0-kube-api-access-6xkrw\") pod \"limitador-operator-controller-manager-859d7b78bd-pxph2\" (UID: \"cc1f0aab-36aa-4f1f-a028-008136cd1cd0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:01.986453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.986428 2575 generic.go:356] "Generic (PLEG): container finished" podID="cb1ca055-24a7-4480-9796-574642164037" containerID="61a962ceedab1ab28e5d8d03855d1b47eef6606f9d2e8bd36316ab8289d26566" exitCode=0 Jul 20 16:22:01.988428 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:01.988392 2575 generic.go:356] "Generic (PLEG): container finished" podID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" containerID="fceaf5cec368acc4d7cbc828cf75b05a41a74da40d222d1054f2234e424b4d39" exitCode=0 Jul 20 16:22:02.008835 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.008815 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:02.011171 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:02.011147 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:02.013333 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:02.013308 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:02.020545 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.020528 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:02.022795 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:02.022775 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:02.024826 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:02.024809 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:02.068184 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.068163 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb1ca055-24a7-4480-9796-574642164037-extensions-socket-volume\") pod \"cb1ca055-24a7-4480-9796-574642164037\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " Jul 20 16:22:02.068271 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.068211 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng48q\" (UniqueName: \"kubernetes.io/projected/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4-kube-api-access-ng48q\") pod \"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4\" (UID: \"29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4\") " Jul 20 16:22:02.068271 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.068228 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h57r4\" (UniqueName: \"kubernetes.io/projected/cb1ca055-24a7-4480-9796-574642164037-kube-api-access-h57r4\") pod \"cb1ca055-24a7-4480-9796-574642164037\" (UID: \"cb1ca055-24a7-4480-9796-574642164037\") " Jul 20 16:22:02.068719 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.068697 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb1ca055-24a7-4480-9796-574642164037-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb1ca055-24a7-4480-9796-574642164037" (UID: "cb1ca055-24a7-4480-9796-574642164037"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:22:02.070186 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.070167 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4-kube-api-access-ng48q" (OuterVolumeSpecName: "kube-api-access-ng48q") pod "29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" (UID: "29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4"). InnerVolumeSpecName "kube-api-access-ng48q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:22:02.070243 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.070179 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb1ca055-24a7-4480-9796-574642164037-kube-api-access-h57r4" (OuterVolumeSpecName: "kube-api-access-h57r4") pod "cb1ca055-24a7-4480-9796-574642164037" (UID: "cb1ca055-24a7-4480-9796-574642164037"). InnerVolumeSpecName "kube-api-access-h57r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:22:02.142355 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.142328 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:02.148323 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.148296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:02.169785 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.169758 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb1ca055-24a7-4480-9796-574642164037-extensions-socket-volume\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:22:02.169785 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.169786 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng48q\" (UniqueName: \"kubernetes.io/projected/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4-kube-api-access-ng48q\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:22:02.169949 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.169795 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h57r4\" (UniqueName: \"kubernetes.io/projected/cb1ca055-24a7-4480-9796-574642164037-kube-api-access-h57r4\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:22:02.282648 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.282461 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp"] Jul 20 16:22:02.285726 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:22:02.285696 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb55210_499d_4ab1_b3d4_a3b9fae11361.slice/crio-4913f9b03ce7fb6c2c724365499d1e3a9c0e8ba822afe868b3a10b5caacba5b0 WatchSource:0}: Error finding container 4913f9b03ce7fb6c2c724365499d1e3a9c0e8ba822afe868b3a10b5caacba5b0: Status 404 returned error can't find the container with id 4913f9b03ce7fb6c2c724365499d1e3a9c0e8ba822afe868b3a10b5caacba5b0 Jul 20 16:22:02.307861 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.307837 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2"] Jul 20 16:22:02.309559 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:22:02.309538 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1f0aab_36aa_4f1f_a028_008136cd1cd0.slice/crio-5996261d2c000cc7e5dbaf863980558600f27229f52349fc11e2bcfcfbb49ef7 WatchSource:0}: Error finding container 5996261d2c000cc7e5dbaf863980558600f27229f52349fc11e2bcfcfbb49ef7: Status 404 returned error can't find the container with id 5996261d2c000cc7e5dbaf863980558600f27229f52349fc11e2bcfcfbb49ef7 Jul 20 16:22:02.994564 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.994482 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:02.995029 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.994490 2575 scope.go:117] "RemoveContainer" containerID="61a962ceedab1ab28e5d8d03855d1b47eef6606f9d2e8bd36316ab8289d26566" Jul 20 16:22:02.996237 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.996208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" event={"ID":"aeb55210-499d-4ab1-b3d4-a3b9fae11361","Type":"ContainerStarted","Data":"e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed"} Jul 20 16:22:02.996385 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.996260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" event={"ID":"aeb55210-499d-4ab1-b3d4-a3b9fae11361","Type":"ContainerStarted","Data":"4913f9b03ce7fb6c2c724365499d1e3a9c0e8ba822afe868b3a10b5caacba5b0"} Jul 20 16:22:02.996385 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.996350 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:02.997686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.997668 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:02.997993 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:02.997966 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:02.999421 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.999395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" event={"ID":"cc1f0aab-36aa-4f1f-a028-008136cd1cd0","Type":"ContainerStarted","Data":"070993a264de2cb623c8c8c5dd9804eaa6c2181cbca7f02fb6a0f166eec93248"} Jul 20 16:22:02.999500 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.999434 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" event={"ID":"cc1f0aab-36aa-4f1f-a028-008136cd1cd0","Type":"ContainerStarted","Data":"5996261d2c000cc7e5dbaf863980558600f27229f52349fc11e2bcfcfbb49ef7"} Jul 20 16:22:02.999500 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:02.999462 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:03.000263 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.000228 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:03.002868 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.002842 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:03.004106 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:03.004091 2575 scope.go:117] "RemoveContainer" containerID="fceaf5cec368acc4d7cbc828cf75b05a41a74da40d222d1054f2234e424b4d39" Jul 20 16:22:03.027346 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:03.027302 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" podStartSLOduration=2.027288633 podStartE2EDuration="2.027288633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:22:03.025978433 +0000 UTC m=+500.182795720" watchObservedRunningTime="2026-07-20 16:22:03.027288633 +0000 UTC m=+500.184105921" Jul 20 16:22:03.046664 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:03.046611 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" podStartSLOduration=2.046602602 podStartE2EDuration="2.046602602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:22:03.045814554 +0000 UTC m=+500.202631842" watchObservedRunningTime="2026-07-20 16:22:03.046602602 +0000 UTC m=+500.203419889" Jul 20 16:22:03.047978 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.047946 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:03.050050 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.050025 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:03.052342 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.052321 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:03.600073 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.600037 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q49nv\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="cb1ca055-24a7-4480-9796-574642164037" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q49nv" Jul 20 16:22:03.601545 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:03.601522 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" path="/var/lib/kubelet/pods/29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4/volumes" Jul 20 16:22:03.601910 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:03.601896 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb1ca055-24a7-4480-9796-574642164037" path="/var/lib/kubelet/pods/cb1ca055-24a7-4480-9796-574642164037/volumes" Jul 20 16:22:03.602279 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:03.602259 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hph8w\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="29f7dfc0-7fbd-4cba-8809-a1b0bef07ef4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hph8w" Jul 20 16:22:03.947488 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:03.947405 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8vlf" Jul 20 16:22:04.296764 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:04.296727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:04.394101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:04.394075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:08.488326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:08.488279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:08.548329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:08.548304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:08.621837 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:08.621806 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:09.900887 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:09.900852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:10.001843 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:10.001807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:12.496315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:12.496279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:12.598004 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:12.597975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:14.008486 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:14.008454 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:14.008865 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:14.008528 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pxph2" Jul 20 16:22:16.294242 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:16.294203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:16.395014 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:16.394984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:23.969519 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:23.969482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:24.069276 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:24.069241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:30.509783 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:30.509745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:30.614545 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:30.614514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:33.440569 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.440536 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp"] Jul 20 16:22:33.440961 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.440783 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" podUID="aeb55210-499d-4ab1-b3d4-a3b9fae11361" containerName="manager" containerID="cri-o://e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed" gracePeriod=10 Jul 20 16:22:33.690464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.690444 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:33.809471 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.809445 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khhjb\" (UniqueName: \"kubernetes.io/projected/aeb55210-499d-4ab1-b3d4-a3b9fae11361-kube-api-access-khhjb\") pod \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " Jul 20 16:22:33.809642 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.809533 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aeb55210-499d-4ab1-b3d4-a3b9fae11361-extensions-socket-volume\") pod \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\" (UID: \"aeb55210-499d-4ab1-b3d4-a3b9fae11361\") " Jul 20 16:22:33.809944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.809921 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb55210-499d-4ab1-b3d4-a3b9fae11361-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aeb55210-499d-4ab1-b3d4-a3b9fae11361" (UID: "aeb55210-499d-4ab1-b3d4-a3b9fae11361"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:22:33.811559 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.811539 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb55210-499d-4ab1-b3d4-a3b9fae11361-kube-api-access-khhjb" (OuterVolumeSpecName: "kube-api-access-khhjb") pod "aeb55210-499d-4ab1-b3d4-a3b9fae11361" (UID: "aeb55210-499d-4ab1-b3d4-a3b9fae11361"). InnerVolumeSpecName "kube-api-access-khhjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:22:33.910743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.910715 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khhjb\" (UniqueName: \"kubernetes.io/projected/aeb55210-499d-4ab1-b3d4-a3b9fae11361-kube-api-access-khhjb\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:22:33.910743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:33.910739 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aeb55210-499d-4ab1-b3d4-a3b9fae11361-extensions-socket-volume\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:22:34.150581 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.150496 2575 generic.go:356] "Generic (PLEG): container finished" podID="aeb55210-499d-4ab1-b3d4-a3b9fae11361" containerID="e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed" exitCode=0 Jul 20 16:22:34.150581 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.150544 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" Jul 20 16:22:34.150809 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.150579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" event={"ID":"aeb55210-499d-4ab1-b3d4-a3b9fae11361","Type":"ContainerDied","Data":"e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed"} Jul 20 16:22:34.150809 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.150651 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp" event={"ID":"aeb55210-499d-4ab1-b3d4-a3b9fae11361","Type":"ContainerDied","Data":"4913f9b03ce7fb6c2c724365499d1e3a9c0e8ba822afe868b3a10b5caacba5b0"} Jul 20 16:22:34.150809 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.150676 2575 scope.go:117] "RemoveContainer" containerID="e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed" Jul 20 16:22:34.161985 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.161966 2575 scope.go:117] "RemoveContainer" containerID="e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed" Jul 20 16:22:34.162209 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:22:34.162190 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed\": container with ID starting with e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed not found: ID does not exist" containerID="e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed" Jul 20 16:22:34.162275 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.162221 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed"} err="failed to get container status \"e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed\": rpc error: code = NotFound desc = could not find container \"e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed\": container with ID starting with e6e35df90309d058110e6a2dba2ef3f2ad9574ba1e4d4cef439ebd4658b192ed not found: ID does not exist" Jul 20 16:22:34.176225 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.176201 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp"] Jul 20 16:22:34.182370 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:34.182351 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hdhwp"] Jul 20 16:22:35.017186 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:35.017151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:35.602111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:35.602073 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb55210-499d-4ab1-b3d4-a3b9fae11361" path="/var/lib/kubelet/pods/aeb55210-499d-4ab1-b3d4-a3b9fae11361/volumes" Jul 20 16:22:49.804926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.804897 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh"] Jul 20 16:22:49.805429 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.805276 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb55210-499d-4ab1-b3d4-a3b9fae11361" containerName="manager" Jul 20 16:22:49.805429 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.805288 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb55210-499d-4ab1-b3d4-a3b9fae11361" containerName="manager" Jul 20 16:22:49.805429 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.805353 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb55210-499d-4ab1-b3d4-a3b9fae11361" containerName="manager" Jul 20 16:22:49.809635 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.809602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.812370 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.812350 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 16:22:49.812559 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.812547 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ptrbx\"" Jul 20 16:22:49.821811 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.821787 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh"] Jul 20 16:22:49.844816 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.844791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:49.931731 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.931811 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.931811 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.931899 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.931899 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dzw\" (UniqueName: \"kubernetes.io/projected/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-kube-api-access-64dzw\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.931972 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.931972 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.932048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.932048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.931989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:49.944412 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:49.944389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:50.033372 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033467 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033467 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dzw\" (UniqueName: \"kubernetes.io/projected/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-kube-api-access-64dzw\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033910 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033775 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.033910 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.033897 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.034064 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.034040 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.034237 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.034213 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.034341 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.034316 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.035759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.035734 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.036043 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.036025 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.042912 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.042887 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.043123 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.043105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dzw\" (UniqueName: \"kubernetes.io/projected/b5898d8b-68a2-4652-b24f-1e01a7d3f8b8-kube-api-access-64dzw\") pod \"maas-default-gateway-openshift-default-56654dcf7-pn7kh\" (UID: \"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.121779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.121723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:50.256004 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:50.255979 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh"] Jul 20 16:22:50.257219 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:22:50.257182 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5898d8b_68a2_4652_b24f_1e01a7d3f8b8.slice/crio-3298797e1ed718d01bddce6e5bc8ac5f38e0d917a81907c360787cc4fb47d04f WatchSource:0}: Error finding container 3298797e1ed718d01bddce6e5bc8ac5f38e0d917a81907c360787cc4fb47d04f: Status 404 returned error can't find the container with id 3298797e1ed718d01bddce6e5bc8ac5f38e0d917a81907c360787cc4fb47d04f Jul 20 16:22:51.232638 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:51.232587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" event={"ID":"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8","Type":"ContainerStarted","Data":"3298797e1ed718d01bddce6e5bc8ac5f38e0d917a81907c360787cc4fb47d04f"} Jul 20 16:22:52.976159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:52.976123 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:22:52.976436 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:52.976194 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:22:52.976436 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:52.976223 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:22:53.246038 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:53.245954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" event={"ID":"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8","Type":"ContainerStarted","Data":"11662c094a84dcc9d9c908b93947e06d3c11b664b54fccc271484e587facfd02"} Jul 20 16:22:53.269023 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:53.268977 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" podStartSLOduration=1.552612841 podStartE2EDuration="4.268963385s" totalImagesPullingTime="2.716350544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:22:53.267880158 +0000 UTC m=+550.424697461" watchObservedRunningTime="2026-07-20 16:22:53.268963385 +0000 UTC m=+550.425780672" Jul 20 16:22:54.121863 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.121816 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:54.126865 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.126841 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:54.250835 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.250804 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:54.251739 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.251710 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:22:54.308978 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.308942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:54.309197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.309178 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:22:54.312769 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.312748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.315432 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.315411 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 16:22:54.315532 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.315415 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nc4th\"" Jul 20 16:22:54.319321 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.319299 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:22:54.413374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.413289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:54.414484 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.414457 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:22:54.478598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.478573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9361bdb3-891f-41a2-9267-9a82bd94ba3a-config-file\") pod \"limitador-limitador-64c94fd64f-q8wxz\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.478734 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.478648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pfw\" (UniqueName: \"kubernetes.io/projected/9361bdb3-891f-41a2-9267-9a82bd94ba3a-kube-api-access-j9pfw\") pod \"limitador-limitador-64c94fd64f-q8wxz\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.510280 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.510233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:54.580090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.580060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9361bdb3-891f-41a2-9267-9a82bd94ba3a-config-file\") pod \"limitador-limitador-64c94fd64f-q8wxz\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.580224 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.580126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pfw\" (UniqueName: \"kubernetes.io/projected/9361bdb3-891f-41a2-9267-9a82bd94ba3a-kube-api-access-j9pfw\") pod \"limitador-limitador-64c94fd64f-q8wxz\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.580693 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.580676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9361bdb3-891f-41a2-9267-9a82bd94ba3a-config-file\") pod \"limitador-limitador-64c94fd64f-q8wxz\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.588469 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.588443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pfw\" (UniqueName: \"kubernetes.io/projected/9361bdb3-891f-41a2-9267-9a82bd94ba3a-kube-api-access-j9pfw\") pod \"limitador-limitador-64c94fd64f-q8wxz\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.623971 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.623947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:54.754911 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:54.754888 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:22:54.756788 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:22:54.756761 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9361bdb3_891f_41a2_9267_9a82bd94ba3a.slice/crio-970847fa2385a40c0eab4c4d057e1c882fd6b1fb8b7342880c7bebfdf877651a WatchSource:0}: Error finding container 970847fa2385a40c0eab4c4d057e1c882fd6b1fb8b7342880c7bebfdf877651a: Status 404 returned error can't find the container with id 970847fa2385a40c0eab4c4d057e1c882fd6b1fb8b7342880c7bebfdf877651a Jul 20 16:22:55.149009 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:55.148977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:55.256072 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:55.256040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:22:55.256406 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:55.256384 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" event={"ID":"9361bdb3-891f-41a2-9267-9a82bd94ba3a","Type":"ContainerStarted","Data":"970847fa2385a40c0eab4c4d057e1c882fd6b1fb8b7342880c7bebfdf877651a"} Jul 20 16:22:58.271945 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:58.271912 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" event={"ID":"9361bdb3-891f-41a2-9267-9a82bd94ba3a","Type":"ContainerStarted","Data":"5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747"} Jul 20 16:22:58.272305 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:58.271980 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:22:58.293884 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:22:58.293833 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" podStartSLOduration=1.468559129 podStartE2EDuration="4.293817404s" totalImagesPullingTime="2.825258275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:22:58.292709247 +0000 UTC m=+555.449526535" watchObservedRunningTime="2026-07-20 16:22:58.293817404 +0000 UTC m=+555.450634690" Jul 20 16:23:08.892388 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:08.892345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:08.992336 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:08.992308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:09.250532 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.250456 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:23:09.250751 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.250724 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" podUID="9361bdb3-891f-41a2-9267-9a82bd94ba3a" containerName="limitador" containerID="cri-o://5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747" gracePeriod=30 Jul 20 16:23:09.251519 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.251501 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:23:09.794706 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.794677 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:23:09.804013 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.803992 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9pfw\" (UniqueName: \"kubernetes.io/projected/9361bdb3-891f-41a2-9267-9a82bd94ba3a-kube-api-access-j9pfw\") pod \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " Jul 20 16:23:09.804112 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.804048 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9361bdb3-891f-41a2-9267-9a82bd94ba3a-config-file\") pod \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\" (UID: \"9361bdb3-891f-41a2-9267-9a82bd94ba3a\") " Jul 20 16:23:09.804374 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.804349 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9361bdb3-891f-41a2-9267-9a82bd94ba3a-config-file" (OuterVolumeSpecName: "config-file") pod "9361bdb3-891f-41a2-9267-9a82bd94ba3a" (UID: "9361bdb3-891f-41a2-9267-9a82bd94ba3a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:23:09.806051 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.806031 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9361bdb3-891f-41a2-9267-9a82bd94ba3a-kube-api-access-j9pfw" (OuterVolumeSpecName: "kube-api-access-j9pfw") pod "9361bdb3-891f-41a2-9267-9a82bd94ba3a" (UID: "9361bdb3-891f-41a2-9267-9a82bd94ba3a"). InnerVolumeSpecName "kube-api-access-j9pfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:23:09.905285 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.905261 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9pfw\" (UniqueName: \"kubernetes.io/projected/9361bdb3-891f-41a2-9267-9a82bd94ba3a-kube-api-access-j9pfw\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:23:09.905285 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:09.905285 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9361bdb3-891f-41a2-9267-9a82bd94ba3a-config-file\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:23:10.327031 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.326991 2575 generic.go:356] "Generic (PLEG): container finished" podID="9361bdb3-891f-41a2-9267-9a82bd94ba3a" containerID="5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747" exitCode=0 Jul 20 16:23:10.327197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.327039 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" Jul 20 16:23:10.327197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.327078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" event={"ID":"9361bdb3-891f-41a2-9267-9a82bd94ba3a","Type":"ContainerDied","Data":"5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747"} Jul 20 16:23:10.327197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.327138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q8wxz" event={"ID":"9361bdb3-891f-41a2-9267-9a82bd94ba3a","Type":"ContainerDied","Data":"970847fa2385a40c0eab4c4d057e1c882fd6b1fb8b7342880c7bebfdf877651a"} Jul 20 16:23:10.327197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.327165 2575 scope.go:117] "RemoveContainer" containerID="5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747" Jul 20 16:23:10.336278 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.336259 2575 scope.go:117] "RemoveContainer" containerID="5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747" Jul 20 16:23:10.336518 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:23:10.336500 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747\": container with ID starting with 5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747 not found: ID does not exist" containerID="5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747" Jul 20 16:23:10.336579 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.336529 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747"} err="failed to get container status \"5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747\": rpc error: code = NotFound desc = could not find container \"5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747\": container with ID starting with 5c299e2aceeef7fd774f73c658e46574f41699eea324430e55af45b697197747 not found: ID does not exist" Jul 20 16:23:10.353860 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.353828 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:23:10.359094 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.359070 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q8wxz"] Jul 20 16:23:10.521820 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.521788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:10.654965 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.654887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:10.899149 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.899118 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pt84g"] Jul 20 16:23:10.899503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.899490 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9361bdb3-891f-41a2-9267-9a82bd94ba3a" containerName="limitador" Jul 20 16:23:10.899503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.899503 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9361bdb3-891f-41a2-9267-9a82bd94ba3a" containerName="limitador" Jul 20 16:23:10.899581 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.899567 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9361bdb3-891f-41a2-9267-9a82bd94ba3a" containerName="limitador" Jul 20 16:23:10.901958 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.901936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:10.906360 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.906304 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-t6ccq\"" Jul 20 16:23:10.911405 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.906961 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 16:23:10.911506 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.907690 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 16:23:10.911566 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.907767 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 20 16:23:10.912725 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.912703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57628af6-6317-44a8-bed1-77b0f013844c-data\") pod \"postgres-69fb4594cf-pt84g\" (UID: \"57628af6-6317-44a8-bed1-77b0f013844c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:10.912810 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.912769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84v5\" (UniqueName: \"kubernetes.io/projected/57628af6-6317-44a8-bed1-77b0f013844c-kube-api-access-l84v5\") pod \"postgres-69fb4594cf-pt84g\" (UID: \"57628af6-6317-44a8-bed1-77b0f013844c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:10.918321 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.918294 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pt84g"] Jul 20 16:23:10.953913 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:10.953884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:11.013560 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.013538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57628af6-6317-44a8-bed1-77b0f013844c-data\") pod \"postgres-69fb4594cf-pt84g\" (UID: \"57628af6-6317-44a8-bed1-77b0f013844c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:11.013705 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.013577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l84v5\" (UniqueName: \"kubernetes.io/projected/57628af6-6317-44a8-bed1-77b0f013844c-kube-api-access-l84v5\") pod \"postgres-69fb4594cf-pt84g\" (UID: \"57628af6-6317-44a8-bed1-77b0f013844c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:11.013992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.013973 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/57628af6-6317-44a8-bed1-77b0f013844c-data\") pod \"postgres-69fb4594cf-pt84g\" (UID: \"57628af6-6317-44a8-bed1-77b0f013844c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:11.021991 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.021962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84v5\" (UniqueName: \"kubernetes.io/projected/57628af6-6317-44a8-bed1-77b0f013844c-kube-api-access-l84v5\") pod \"postgres-69fb4594cf-pt84g\" (UID: \"57628af6-6317-44a8-bed1-77b0f013844c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:11.223379 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.223311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:11.352126 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.352105 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pt84g"] Jul 20 16:23:11.353793 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:23:11.353766 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57628af6_6317_44a8_bed1_77b0f013844c.slice/crio-ebf9fcadb10ee52db50b4a355300378cdecc36a84bb14026f228129548e6b34f WatchSource:0}: Error finding container ebf9fcadb10ee52db50b4a355300378cdecc36a84bb14026f228129548e6b34f: Status 404 returned error can't find the container with id ebf9fcadb10ee52db50b4a355300378cdecc36a84bb14026f228129548e6b34f Jul 20 16:23:11.602343 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:11.602310 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9361bdb3-891f-41a2-9267-9a82bd94ba3a" path="/var/lib/kubelet/pods/9361bdb3-891f-41a2-9267-9a82bd94ba3a/volumes" Jul 20 16:23:12.346497 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:12.346422 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" event={"ID":"57628af6-6317-44a8-bed1-77b0f013844c","Type":"ContainerStarted","Data":"ebf9fcadb10ee52db50b4a355300378cdecc36a84bb14026f228129548e6b34f"} Jul 20 16:23:17.373689 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:17.373652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" event={"ID":"57628af6-6317-44a8-bed1-77b0f013844c","Type":"ContainerStarted","Data":"244cdc802ad72dc57a1389f0a1833f04fb44288ed70d261c90d4922085b4dfff"} Jul 20 16:23:17.374091 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:17.373734 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:17.391134 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:17.391087 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" podStartSLOduration=2.367002456 podStartE2EDuration="7.391074439s" totalImagesPullingTime="5.024071983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:23:17.389928286 +0000 UTC m=+574.546745574" watchObservedRunningTime="2026-07-20 16:23:17.391074439 +0000 UTC m=+574.547891726" Jul 20 16:23:23.366326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.366296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:23.408527 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.408505 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pt84g" Jul 20 16:23:23.434334 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.434306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:23.734914 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.734832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:23.953115 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.953086 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6c9rm"] Jul 20 16:23:23.959845 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.959811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:23.962827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.962741 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ggqpn\"" Jul 20 16:23:23.965157 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:23.965120 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6c9rm"] Jul 20 16:23:24.017299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.017271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8wsl\" (UniqueName: \"kubernetes.io/projected/bf716224-ec84-40fd-82ce-42b7b1990d80-kube-api-access-t8wsl\") pod \"authorino-5d4b67c446-6c9rm\" (UID: \"bf716224-ec84-40fd-82ce-42b7b1990d80\") " pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:24.118462 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.118432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8wsl\" (UniqueName: \"kubernetes.io/projected/bf716224-ec84-40fd-82ce-42b7b1990d80-kube-api-access-t8wsl\") pod \"authorino-5d4b67c446-6c9rm\" (UID: \"bf716224-ec84-40fd-82ce-42b7b1990d80\") " pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:24.127207 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.127180 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8wsl\" (UniqueName: \"kubernetes.io/projected/bf716224-ec84-40fd-82ce-42b7b1990d80-kube-api-access-t8wsl\") pod \"authorino-5d4b67c446-6c9rm\" (UID: \"bf716224-ec84-40fd-82ce-42b7b1990d80\") " pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:24.141886 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.141860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:24.195385 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.195362 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6c9rm"] Jul 20 16:23:24.195573 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.195561 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:24.324695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.324668 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6c9rm"] Jul 20 16:23:24.326751 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:23:24.326726 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf716224_ec84_40fd_82ce_42b7b1990d80.slice/crio-83b4eb3c4f38ec13cd43ab1e1982ef917bce24f0d4e91c1cbe6a7bf74bc91063 WatchSource:0}: Error finding container 83b4eb3c4f38ec13cd43ab1e1982ef917bce24f0d4e91c1cbe6a7bf74bc91063: Status 404 returned error can't find the container with id 83b4eb3c4f38ec13cd43ab1e1982ef917bce24f0d4e91c1cbe6a7bf74bc91063 Jul 20 16:23:24.413524 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.413495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" event={"ID":"bf716224-ec84-40fd-82ce-42b7b1990d80","Type":"ContainerStarted","Data":"83b4eb3c4f38ec13cd43ab1e1982ef917bce24f0d4e91c1cbe6a7bf74bc91063"} Jul 20 16:23:24.491532 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.491503 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-846b5978fd-wg7dw"] Jul 20 16:23:24.497400 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.497379 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.500527 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.500505 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 20 16:23:24.501501 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.501482 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-846b5978fd-wg7dw"] Jul 20 16:23:24.522093 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.522074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c84547b-ee98-40dd-babe-93556bc85c40-tls-cert\") pod \"authorino-846b5978fd-wg7dw\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.522191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.522109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgcs4\" (UniqueName: \"kubernetes.io/projected/5c84547b-ee98-40dd-babe-93556bc85c40-kube-api-access-wgcs4\") pod \"authorino-846b5978fd-wg7dw\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.622828 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.622756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c84547b-ee98-40dd-babe-93556bc85c40-tls-cert\") pod \"authorino-846b5978fd-wg7dw\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.622828 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.622808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgcs4\" (UniqueName: \"kubernetes.io/projected/5c84547b-ee98-40dd-babe-93556bc85c40-kube-api-access-wgcs4\") pod \"authorino-846b5978fd-wg7dw\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.625520 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.625498 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c84547b-ee98-40dd-babe-93556bc85c40-tls-cert\") pod \"authorino-846b5978fd-wg7dw\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.630488 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.630469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgcs4\" (UniqueName: \"kubernetes.io/projected/5c84547b-ee98-40dd-babe-93556bc85c40-kube-api-access-wgcs4\") pod \"authorino-846b5978fd-wg7dw\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:24.808186 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:24.808155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:23:25.011694 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:25.011668 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-846b5978fd-wg7dw"] Jul 20 16:23:25.014565 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:23:25.014530 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c84547b_ee98_40dd_babe_93556bc85c40.slice/crio-012430d2be1e604ae2d239b1509c3a8c13f2f841c5b1897247364338da56f214 WatchSource:0}: Error finding container 012430d2be1e604ae2d239b1509c3a8c13f2f841c5b1897247364338da56f214: Status 404 returned error can't find the container with id 012430d2be1e604ae2d239b1509c3a8c13f2f841c5b1897247364338da56f214 Jul 20 16:23:25.421074 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:25.421031 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846b5978fd-wg7dw" event={"ID":"5c84547b-ee98-40dd-babe-93556bc85c40","Type":"ContainerStarted","Data":"012430d2be1e604ae2d239b1509c3a8c13f2f841c5b1897247364338da56f214"} Jul 20 16:23:28.439636 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.439575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846b5978fd-wg7dw" event={"ID":"5c84547b-ee98-40dd-babe-93556bc85c40","Type":"ContainerStarted","Data":"75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8"} Jul 20 16:23:28.441083 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.441044 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" event={"ID":"bf716224-ec84-40fd-82ce-42b7b1990d80","Type":"ContainerStarted","Data":"438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3"} Jul 20 16:23:28.441207 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.441122 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" podUID="bf716224-ec84-40fd-82ce-42b7b1990d80" containerName="authorino" containerID="cri-o://438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3" gracePeriod=30 Jul 20 16:23:28.456788 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.456746 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-846b5978fd-wg7dw" podStartSLOduration=1.469926168 podStartE2EDuration="4.456733248s" totalImagesPullingTime="2.98680708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:23:28.455663511 +0000 UTC m=+585.612480801" watchObservedRunningTime="2026-07-20 16:23:28.456733248 +0000 UTC m=+585.613550535" Jul 20 16:23:28.473154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.473114 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" podStartSLOduration=1.811039156 podStartE2EDuration="5.473099309s" totalImagesPullingTime="3.662060153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:23:28.471762911 +0000 UTC m=+585.628580199" watchObservedRunningTime="2026-07-20 16:23:28.473099309 +0000 UTC m=+585.629916596" Jul 20 16:23:28.711975 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.711911 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:28.759804 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.759778 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8wsl\" (UniqueName: \"kubernetes.io/projected/bf716224-ec84-40fd-82ce-42b7b1990d80-kube-api-access-t8wsl\") pod \"bf716224-ec84-40fd-82ce-42b7b1990d80\" (UID: \"bf716224-ec84-40fd-82ce-42b7b1990d80\") " Jul 20 16:23:28.761826 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.761800 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf716224-ec84-40fd-82ce-42b7b1990d80-kube-api-access-t8wsl" (OuterVolumeSpecName: "kube-api-access-t8wsl") pod "bf716224-ec84-40fd-82ce-42b7b1990d80" (UID: "bf716224-ec84-40fd-82ce-42b7b1990d80"). InnerVolumeSpecName "kube-api-access-t8wsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:23:28.861280 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:28.861249 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8wsl\" (UniqueName: \"kubernetes.io/projected/bf716224-ec84-40fd-82ce-42b7b1990d80-kube-api-access-t8wsl\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:23:29.446867 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.446783 2575 generic.go:356] "Generic (PLEG): container finished" podID="bf716224-ec84-40fd-82ce-42b7b1990d80" containerID="438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3" exitCode=0 Jul 20 16:23:29.446867 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.446826 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" Jul 20 16:23:29.447330 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.446861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" event={"ID":"bf716224-ec84-40fd-82ce-42b7b1990d80","Type":"ContainerDied","Data":"438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3"} Jul 20 16:23:29.447330 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.446900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6c9rm" event={"ID":"bf716224-ec84-40fd-82ce-42b7b1990d80","Type":"ContainerDied","Data":"83b4eb3c4f38ec13cd43ab1e1982ef917bce24f0d4e91c1cbe6a7bf74bc91063"} Jul 20 16:23:29.447330 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.446915 2575 scope.go:117] "RemoveContainer" containerID="438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3" Jul 20 16:23:29.455969 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.455950 2575 scope.go:117] "RemoveContainer" containerID="438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3" Jul 20 16:23:29.456229 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:23:29.456209 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3\": container with ID starting with 438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3 not found: ID does not exist" containerID="438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3" Jul 20 16:23:29.456286 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.456236 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3"} err="failed to get container status \"438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3\": rpc error: code = NotFound desc = could not find container \"438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3\": container with ID starting with 438201e159f815c7744b06545915a96ca4cd8545dd565976a0c4905fd1babfc3 not found: ID does not exist" Jul 20 16:23:29.469719 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.469696 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6c9rm"] Jul 20 16:23:29.473630 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.473601 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6c9rm"] Jul 20 16:23:29.602085 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:29.602057 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf716224-ec84-40fd-82ce-42b7b1990d80" path="/var/lib/kubelet/pods/bf716224-ec84-40fd-82ce-42b7b1990d80/volumes" Jul 20 16:23:33.353553 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.353519 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:33.382412 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.382385 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6554d9667b-4ssjg"] Jul 20 16:23:33.382808 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.382793 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf716224-ec84-40fd-82ce-42b7b1990d80" containerName="authorino" Jul 20 16:23:33.382861 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.382810 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf716224-ec84-40fd-82ce-42b7b1990d80" containerName="authorino" Jul 20 16:23:33.385209 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.383295 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf716224-ec84-40fd-82ce-42b7b1990d80" containerName="authorino" Jul 20 16:23:33.402319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.402292 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:33.402891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.402869 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6554d9667b-4ssjg"] Jul 20 16:23:33.406522 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.406502 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8674p\"" Jul 20 16:23:33.407759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.407738 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 20 16:23:33.408155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.408139 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 20 16:23:33.468713 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.468688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:33.500899 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.500871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw72\" (UniqueName: \"kubernetes.io/projected/f010a773-a7fd-44d0-8a67-245120747b6a-kube-api-access-rrw72\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:33.501023 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.500927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:33.557249 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.557216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:33.601749 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.601729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:33.601860 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.601785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw72\" (UniqueName: \"kubernetes.io/projected/f010a773-a7fd-44d0-8a67-245120747b6a-kube-api-access-rrw72\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:33.601922 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:23:33.601898 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 20 16:23:33.601990 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:23:33.601980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert podName:f010a773-a7fd-44d0-8a67-245120747b6a nodeName:}" failed. No retries permitted until 2026-07-20 16:23:34.101960805 +0000 UTC m=+591.258778119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert") pod "maas-controller-6554d9667b-4ssjg" (UID: "f010a773-a7fd-44d0-8a67-245120747b6a") : secret "maas-controller-webhook-cert" not found Jul 20 16:23:33.620122 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.620074 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw72\" (UniqueName: \"kubernetes.io/projected/f010a773-a7fd-44d0-8a67-245120747b6a-kube-api-access-rrw72\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:33.771911 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:33.771879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:34.105094 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:34.105061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:34.107424 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:34.107398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert\") pod \"maas-controller-6554d9667b-4ssjg\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:34.317292 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:34.317255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:34.449716 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:34.449693 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6554d9667b-4ssjg"] Jul 20 16:23:34.451559 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:23:34.451532 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf010a773_a7fd_44d0_8a67_245120747b6a.slice/crio-ca123b194e0dbf12b6ddf61854da595357cdf425a571d06e1daf49dd1c10d29b WatchSource:0}: Error finding container ca123b194e0dbf12b6ddf61854da595357cdf425a571d06e1daf49dd1c10d29b: Status 404 returned error can't find the container with id ca123b194e0dbf12b6ddf61854da595357cdf425a571d06e1daf49dd1c10d29b Jul 20 16:23:34.473101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:34.473079 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6554d9667b-4ssjg" event={"ID":"f010a773-a7fd-44d0-8a67-245120747b6a","Type":"ContainerStarted","Data":"ca123b194e0dbf12b6ddf61854da595357cdf425a571d06e1daf49dd1c10d29b"} Jul 20 16:23:36.502046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:36.501929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:36.653488 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:36.653463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:37.490681 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:37.490651 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6554d9667b-4ssjg" event={"ID":"f010a773-a7fd-44d0-8a67-245120747b6a","Type":"ContainerStarted","Data":"48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69"} Jul 20 16:23:37.490858 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:37.490782 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:37.549370 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:37.549324 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6554d9667b-4ssjg" podStartSLOduration=2.37296163 podStartE2EDuration="4.54930957s" totalImagesPullingTime="2.17634794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:23:37.547122628 +0000 UTC m=+594.703939916" watchObservedRunningTime="2026-07-20 16:23:37.54930957 +0000 UTC m=+594.706126856" Jul 20 16:23:43.300959 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:43.300929 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:23:43.302314 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:43.302291 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:23:43.306013 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:43.305990 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:23:43.307203 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:43.307182 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:23:47.786609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:47.786575 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6554d9667b-4ssjg"] Jul 20 16:23:47.787169 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:47.786796 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6554d9667b-4ssjg" podUID="f010a773-a7fd-44d0-8a67-245120747b6a" containerName="manager" containerID="cri-o://48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69" gracePeriod=30 Jul 20 16:23:47.788519 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:47.788498 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:48.038392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.038329 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:48.122145 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.122122 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert\") pod \"f010a773-a7fd-44d0-8a67-245120747b6a\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " Jul 20 16:23:48.122280 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.122180 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrw72\" (UniqueName: \"kubernetes.io/projected/f010a773-a7fd-44d0-8a67-245120747b6a-kube-api-access-rrw72\") pod \"f010a773-a7fd-44d0-8a67-245120747b6a\" (UID: \"f010a773-a7fd-44d0-8a67-245120747b6a\") " Jul 20 16:23:48.124326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.124296 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f010a773-a7fd-44d0-8a67-245120747b6a-kube-api-access-rrw72" (OuterVolumeSpecName: "kube-api-access-rrw72") pod "f010a773-a7fd-44d0-8a67-245120747b6a" (UID: "f010a773-a7fd-44d0-8a67-245120747b6a"). InnerVolumeSpecName "kube-api-access-rrw72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:23:48.124433 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.124366 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f010a773-a7fd-44d0-8a67-245120747b6a" (UID: "f010a773-a7fd-44d0-8a67-245120747b6a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:23:48.223098 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.223070 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f010a773-a7fd-44d0-8a67-245120747b6a-webhook-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:23:48.223098 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.223094 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrw72\" (UniqueName: \"kubernetes.io/projected/f010a773-a7fd-44d0-8a67-245120747b6a-kube-api-access-rrw72\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:23:48.543802 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.543771 2575 generic.go:356] "Generic (PLEG): container finished" podID="f010a773-a7fd-44d0-8a67-245120747b6a" containerID="48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69" exitCode=0 Jul 20 16:23:48.543973 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.543815 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6554d9667b-4ssjg" Jul 20 16:23:48.543973 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.543863 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6554d9667b-4ssjg" event={"ID":"f010a773-a7fd-44d0-8a67-245120747b6a","Type":"ContainerDied","Data":"48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69"} Jul 20 16:23:48.543973 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.543918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6554d9667b-4ssjg" event={"ID":"f010a773-a7fd-44d0-8a67-245120747b6a","Type":"ContainerDied","Data":"ca123b194e0dbf12b6ddf61854da595357cdf425a571d06e1daf49dd1c10d29b"} Jul 20 16:23:48.543973 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.543944 2575 scope.go:117] "RemoveContainer" containerID="48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69" Jul 20 16:23:48.553080 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.553064 2575 scope.go:117] "RemoveContainer" containerID="48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69" Jul 20 16:23:48.553334 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:23:48.553317 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69\": container with ID starting with 48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69 not found: ID does not exist" containerID="48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69" Jul 20 16:23:48.553387 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.553341 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69"} err="failed to get container status \"48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69\": rpc error: code = NotFound desc = could not find container \"48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69\": container with ID starting with 48cb9ca2675ef86dab42efba3f45651e2d246f47731150ca21be52c78fa8ed69 not found: ID does not exist" Jul 20 16:23:48.565724 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.565701 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6554d9667b-4ssjg"] Jul 20 16:23:48.571665 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.571645 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6554d9667b-4ssjg"] Jul 20 16:23:48.924890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:48.924799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:23:49.601711 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:23:49.601684 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f010a773-a7fd-44d0-8a67-245120747b6a" path="/var/lib/kubelet/pods/f010a773-a7fd-44d0-8a67-245120747b6a/volumes" Jul 20 16:24:08.198343 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.198265 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:08.882121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.882085 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-855c688b74-2r448"] Jul 20 16:24:08.882677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.882651 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f010a773-a7fd-44d0-8a67-245120747b6a" containerName="manager" Jul 20 16:24:08.882677 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.882673 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f010a773-a7fd-44d0-8a67-245120747b6a" containerName="manager" Jul 20 16:24:08.882928 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.882817 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f010a773-a7fd-44d0-8a67-245120747b6a" containerName="manager" Jul 20 16:24:08.885919 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.885904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.888636 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.888588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9lzf\" (UniqueName: \"kubernetes.io/projected/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-kube-api-access-z9lzf\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.888763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.888608 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 20 16:24:08.888763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.888673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-maas-api-tls\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.888763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.888677 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bjg5\"" Jul 20 16:24:08.888763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.888744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-openshift-service-ca\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.897237 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.897211 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-855c688b74-2r448"] Jul 20 16:24:08.989220 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.989188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-openshift-service-ca\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.989417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.989256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9lzf\" (UniqueName: \"kubernetes.io/projected/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-kube-api-access-z9lzf\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.989417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.989285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-maas-api-tls\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.990174 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.990152 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-openshift-service-ca\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.991761 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.991737 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-maas-api-tls\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:08.998526 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:08.998507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9lzf\" (UniqueName: \"kubernetes.io/projected/fdb25f3a-a633-47eb-a1a5-024460ccc5f4-kube-api-access-z9lzf\") pod \"maas-api-855c688b74-2r448\" (UID: \"fdb25f3a-a633-47eb-a1a5-024460ccc5f4\") " pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:09.198610 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.198537 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:09.344497 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.344471 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-855c688b74-2r448"] Jul 20 16:24:09.346706 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:24:09.346670 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb25f3a_a633_47eb_a1a5_024460ccc5f4.slice/crio-5d48e084308fa1437094f91db13f93893f0f6adaddac667d954395058e06ae3a WatchSource:0}: Error finding container 5d48e084308fa1437094f91db13f93893f0f6adaddac667d954395058e06ae3a: Status 404 returned error can't find the container with id 5d48e084308fa1437094f91db13f93893f0f6adaddac667d954395058e06ae3a Jul 20 16:24:09.433838 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.433810 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bg7qc"] Jul 20 16:24:09.439560 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.439541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.442513 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.442492 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 16:24:09.442643 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.442531 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vwsw6\"" Jul 20 16:24:09.454050 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.450205 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bg7qc"] Jul 20 16:24:09.492364 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.492341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd6c1d7d-68d1-44bd-8f27-562088ce9397-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bg7qc\" (UID: \"bd6c1d7d-68d1-44bd-8f27-562088ce9397\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.492474 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.492373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk28f\" (UniqueName: \"kubernetes.io/projected/bd6c1d7d-68d1-44bd-8f27-562088ce9397-kube-api-access-pk28f\") pod \"payload-pre-processing-7677b774bb-bg7qc\" (UID: \"bd6c1d7d-68d1-44bd-8f27-562088ce9397\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.592840 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.592809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd6c1d7d-68d1-44bd-8f27-562088ce9397-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bg7qc\" (UID: \"bd6c1d7d-68d1-44bd-8f27-562088ce9397\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.593015 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.592857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk28f\" (UniqueName: \"kubernetes.io/projected/bd6c1d7d-68d1-44bd-8f27-562088ce9397-kube-api-access-pk28f\") pod \"payload-pre-processing-7677b774bb-bg7qc\" (UID: \"bd6c1d7d-68d1-44bd-8f27-562088ce9397\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.593603 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.593574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd6c1d7d-68d1-44bd-8f27-562088ce9397-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bg7qc\" (UID: \"bd6c1d7d-68d1-44bd-8f27-562088ce9397\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.602979 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.602956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk28f\" (UniqueName: \"kubernetes.io/projected/bd6c1d7d-68d1-44bd-8f27-562088ce9397-kube-api-access-pk28f\") pod \"payload-pre-processing-7677b774bb-bg7qc\" (UID: \"bd6c1d7d-68d1-44bd-8f27-562088ce9397\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.648159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.648136 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" event={"ID":"fdb25f3a-a633-47eb-a1a5-024460ccc5f4","Type":"ContainerStarted","Data":"5d48e084308fa1437094f91db13f93893f0f6adaddac667d954395058e06ae3a"} Jul 20 16:24:09.753803 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.753723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:09.800221 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:09.800189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:10.096129 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:10.096099 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bg7qc"] Jul 20 16:24:10.098728 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:24:10.098700 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6c1d7d_68d1_44bd_8f27_562088ce9397.slice/crio-0d7cb9064dc9efd3e8967c05d01c1b9190735f40059d0cf7e9c332ac955923df WatchSource:0}: Error finding container 0d7cb9064dc9efd3e8967c05d01c1b9190735f40059d0cf7e9c332ac955923df: Status 404 returned error can't find the container with id 0d7cb9064dc9efd3e8967c05d01c1b9190735f40059d0cf7e9c332ac955923df Jul 20 16:24:10.659279 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:10.659239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" event={"ID":"bd6c1d7d-68d1-44bd-8f27-562088ce9397","Type":"ContainerStarted","Data":"0d7cb9064dc9efd3e8967c05d01c1b9190735f40059d0cf7e9c332ac955923df"} Jul 20 16:24:11.676964 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:11.676894 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" event={"ID":"fdb25f3a-a633-47eb-a1a5-024460ccc5f4","Type":"ContainerStarted","Data":"8b983f39a2d5d61e6944dccc229a80ec3fbe578e2afb085f9478d47226ebaa9c"} Jul 20 16:24:11.677412 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:11.677143 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:11.700049 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:11.700001 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" podStartSLOduration=1.5285991349999999 podStartE2EDuration="3.699985691s" totalImagesPullingTime="2.171386556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:24:11.69720083 +0000 UTC m=+628.854018118" watchObservedRunningTime="2026-07-20 16:24:11.699985691 +0000 UTC m=+628.856802977" Jul 20 16:24:13.687942 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:13.687906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" event={"ID":"bd6c1d7d-68d1-44bd-8f27-562088ce9397","Type":"ContainerStarted","Data":"115743fb989ce4216fa987fb446c238759cffb70ae3c7b34b7a59cddb2b1c274"} Jul 20 16:24:13.688382 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:13.688032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:13.705234 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:13.705183 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" podStartSLOduration=1.827756567 podStartE2EDuration="4.705168425s" totalImagesPullingTime="2.877411858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:24:13.703098873 +0000 UTC m=+630.859916196" watchObservedRunningTime="2026-07-20 16:24:13.705168425 +0000 UTC m=+630.861985712" Jul 20 16:24:17.687191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.687163 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-855c688b74-2r448" Jul 20 16:24:17.710413 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.710380 2575 generic.go:356] "Generic (PLEG): container finished" podID="b5898d8b-68a2-4652-b24f-1e01a7d3f8b8" containerID="11662c094a84dcc9d9c908b93947e06d3c11b664b54fccc271484e587facfd02" exitCode=0 Jul 20 16:24:17.710578 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.710449 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" event={"ID":"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8","Type":"ContainerDied","Data":"11662c094a84dcc9d9c908b93947e06d3c11b664b54fccc271484e587facfd02"} Jul 20 16:24:17.710891 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.710874 2575 scope.go:117] "RemoveContainer" containerID="11662c094a84dcc9d9c908b93947e06d3c11b664b54fccc271484e587facfd02" Jul 20 16:24:17.712013 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.711987 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:24:17.712078 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.712050 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:24:17.712124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:17.712081 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:24:18.717555 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:18.717522 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" event={"ID":"b5898d8b-68a2-4652-b24f-1e01a7d3f8b8","Type":"ContainerStarted","Data":"d3d1523ba9674b9189fa36dabeed2e8cf95ecbde23e1d059b00acec0c4d33389"} Jul 20 16:24:19.122322 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:19.122289 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:24:19.122497 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:19.122426 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pn7kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 16:24:19.122497 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:19.122475 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" podUID="b5898d8b-68a2-4652-b24f-1e01a7d3f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 16:24:19.517941 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:19.517909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:19.638836 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:19.638805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:20.122484 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:20.122448 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pn7kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 16:24:20.122899 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:20.122504 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" podUID="b5898d8b-68a2-4652-b24f-1e01a7d3f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 16:24:21.122101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:21.122064 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pn7kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 16:24:21.122276 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:21.122117 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" podUID="b5898d8b-68a2-4652-b24f-1e01a7d3f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 16:24:22.122962 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:22.122922 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pn7kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 20 16:24:22.123361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:22.122978 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" podUID="b5898d8b-68a2-4652-b24f-1e01a7d3f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 20 16:24:23.126105 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:23.126072 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:24:23.126463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:23.126329 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:24:23.127138 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:23.127119 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pn7kh" Jul 20 16:24:24.660137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:24.660095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:24.694401 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:24.694364 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" podUID="bd6c1d7d-68d1-44bd-8f27-562088ce9397" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.47:9004: connect: connection refused" Jul 20 16:24:25.308684 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.308653 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4"] Jul 20 16:24:25.312383 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.312362 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.317898 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.317867 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 16:24:25.318202 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.317872 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mmwbr\"" Jul 20 16:24:25.318508 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.318453 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 16:24:25.326757 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.326735 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 20 16:24:25.327289 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.327270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4"] Jul 20 16:24:25.343464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.343424 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:25.428636 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.428597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31284ea8-02bb-4b5d-8aff-20a2d07617a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.428752 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.428647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5fv\" (UniqueName: \"kubernetes.io/projected/31284ea8-02bb-4b5d-8aff-20a2d07617a1-kube-api-access-vk5fv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.428752 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.428666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.428752 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.428724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.428870 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.428776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.428870 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.428842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.529933 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.529906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.529965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31284ea8-02bb-4b5d-8aff-20a2d07617a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.529985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5fv\" (UniqueName: \"kubernetes.io/projected/31284ea8-02bb-4b5d-8aff-20a2d07617a1-kube-api-access-vk5fv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.530002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.530023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.530038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530410 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.530377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530410 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.530405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.530557 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.530425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.532396 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.532379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31284ea8-02bb-4b5d-8aff-20a2d07617a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.532507 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.532489 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31284ea8-02bb-4b5d-8aff-20a2d07617a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.538033 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.538013 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5fv\" (UniqueName: \"kubernetes.io/projected/31284ea8-02bb-4b5d-8aff-20a2d07617a1-kube-api-access-vk5fv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4\" (UID: \"31284ea8-02bb-4b5d-8aff-20a2d07617a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.630704 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.630639 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:25.783224 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:25.783193 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4"] Jul 20 16:24:25.785471 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:24:25.785447 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31284ea8_02bb_4b5d_8aff_20a2d07617a1.slice/crio-4f57bac16a0d32b6527e4373d70ba9785d5bd62ff4502b55d9755dc398161398 WatchSource:0}: Error finding container 4f57bac16a0d32b6527e4373d70ba9785d5bd62ff4502b55d9755dc398161398: Status 404 returned error can't find the container with id 4f57bac16a0d32b6527e4373d70ba9785d5bd62ff4502b55d9755dc398161398 Jul 20 16:24:26.758810 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:26.758777 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" event={"ID":"31284ea8-02bb-4b5d-8aff-20a2d07617a1","Type":"ContainerStarted","Data":"4f57bac16a0d32b6527e4373d70ba9785d5bd62ff4502b55d9755dc398161398"} Jul 20 16:24:27.764594 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:27.764556 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" event={"ID":"31284ea8-02bb-4b5d-8aff-20a2d07617a1","Type":"ContainerStarted","Data":"912887b9ed889b0f4f64609bb94f27d4954fb58f543be9008c024a187ee1c2ec"} Jul 20 16:24:27.784685 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:27.784640 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" podStartSLOduration=1.678944033 podStartE2EDuration="2.784610228s" totalImagesPullingTime="1.105666195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:24:27.782326288 +0000 UTC m=+644.939143576" watchObservedRunningTime="2026-07-20 16:24:27.784610228 +0000 UTC m=+644.941427538" Jul 20 16:24:34.693600 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.693565 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv"] Jul 20 16:24:34.697549 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.697527 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-bg7qc" Jul 20 16:24:34.697794 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.697773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.700604 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.700585 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 20 16:24:34.718502 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.718475 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv"] Jul 20 16:24:34.752173 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.752143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:34.811829 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.811800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.811992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.811836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681501bd-1cd0-45a1-9a77-d0d321ea023d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.811992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.811901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmp9k\" (UniqueName: \"kubernetes.io/projected/681501bd-1cd0-45a1-9a77-d0d321ea023d-kube-api-access-lmp9k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.811992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.811955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.811992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.811979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.812186 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.812058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913340 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913504 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913504 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913389 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681501bd-1cd0-45a1-9a77-d0d321ea023d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913504 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9k\" (UniqueName: \"kubernetes.io/projected/681501bd-1cd0-45a1-9a77-d0d321ea023d-kube-api-access-lmp9k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913504 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913750 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913829 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913904 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.913904 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.913882 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.915696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.915671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681501bd-1cd0-45a1-9a77-d0d321ea023d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.915864 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.915848 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681501bd-1cd0-45a1-9a77-d0d321ea023d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:34.928154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:34.928132 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmp9k\" (UniqueName: \"kubernetes.io/projected/681501bd-1cd0-45a1-9a77-d0d321ea023d-kube-api-access-lmp9k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9njwv\" (UID: \"681501bd-1cd0-45a1-9a77-d0d321ea023d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:35.010293 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.010266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:35.155596 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.155571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv"] Jul 20 16:24:35.156544 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:24:35.156519 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681501bd_1cd0_45a1_9a77_d0d321ea023d.slice/crio-ded0bb0e3a234464c347eb8a197a3a31b6a6289341004e577ff42824be8d34ee WatchSource:0}: Error finding container ded0bb0e3a234464c347eb8a197a3a31b6a6289341004e577ff42824be8d34ee: Status 404 returned error can't find the container with id ded0bb0e3a234464c347eb8a197a3a31b6a6289341004e577ff42824be8d34ee Jul 20 16:24:35.601046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.601004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:24:35.631411 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.631336 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:35.631411 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.631397 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:35.643963 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.643934 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:35.804171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.804127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" event={"ID":"681501bd-1cd0-45a1-9a77-d0d321ea023d","Type":"ContainerStarted","Data":"d22da933218af5529b2b25bc949650d2918548b3be2b66e7c1b8d565453a0a5c"} Jul 20 16:24:35.804603 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.804201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" event={"ID":"681501bd-1cd0-45a1-9a77-d0d321ea023d","Type":"ContainerStarted","Data":"ded0bb0e3a234464c347eb8a197a3a31b6a6289341004e577ff42824be8d34ee"} Jul 20 16:24:35.816038 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.816011 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4" Jul 20 16:24:35.827386 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:35.827334 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" podStartSLOduration=1.603477143 podStartE2EDuration="1.827313833s" totalImagesPullingTime="223.83669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:24:35.825774926 +0000 UTC m=+652.982592215" watchObservedRunningTime="2026-07-20 16:24:35.827313833 +0000 UTC m=+652.984131121" Jul 20 16:24:45.010729 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:45.010686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:45.011146 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:45.010759 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:45.023153 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:45.023131 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:24:45.865161 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:24:45.865124 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9njwv" Jul 20 16:25:00.853356 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:00.853318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:25:07.215353 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:07.215318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:25:16.705127 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.705095 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg"] Jul 20 16:25:16.708514 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.708499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.711286 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.711268 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 20 16:25:16.718079 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.718053 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg"] Jul 20 16:25:16.747883 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.747857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.747971 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.747892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.747971 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.747915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.748058 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.748045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9cb1668-9b39-49e7-8f94-d84228b6cb85-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.748101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.748067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gxd\" (UniqueName: \"kubernetes.io/projected/a9cb1668-9b39-49e7-8f94-d84228b6cb85-kube-api-access-p2gxd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.748101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.748086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.801044 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.801013 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:25:16.849033 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849156 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9cb1668-9b39-49e7-8f94-d84228b6cb85-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849156 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gxd\" (UniqueName: \"kubernetes.io/projected/a9cb1668-9b39-49e7-8f94-d84228b6cb85-kube-api-access-p2gxd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849156 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849332 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849332 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849439 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849546 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.849718 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.849683 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.851431 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.851410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9cb1668-9b39-49e7-8f94-d84228b6cb85-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.851759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.851737 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9cb1668-9b39-49e7-8f94-d84228b6cb85-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:16.857871 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:16.857853 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gxd\" (UniqueName: \"kubernetes.io/projected/a9cb1668-9b39-49e7-8f94-d84228b6cb85-kube-api-access-p2gxd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kmnxg\" (UID: \"a9cb1668-9b39-49e7-8f94-d84228b6cb85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:17.018786 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:17.018761 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:17.166464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:17.166443 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg"] Jul 20 16:25:17.169268 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:25:17.169242 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cb1668_9b39_49e7_8f94_d84228b6cb85.slice/crio-6ebb206d13102ae9c79f342071c13eb24c2d46da6cb2961945d04bdab199cf4c WatchSource:0}: Error finding container 6ebb206d13102ae9c79f342071c13eb24c2d46da6cb2961945d04bdab199cf4c: Status 404 returned error can't find the container with id 6ebb206d13102ae9c79f342071c13eb24c2d46da6cb2961945d04bdab199cf4c Jul 20 16:25:17.170997 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:17.170976 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:25:18.010732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:18.010696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" event={"ID":"a9cb1668-9b39-49e7-8f94-d84228b6cb85","Type":"ContainerStarted","Data":"b258cf887e65f48bf11b007d7cbd72f02bfed4303c03eba8030fa390bd75192d"} Jul 20 16:25:18.011094 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:18.010746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" event={"ID":"a9cb1668-9b39-49e7-8f94-d84228b6cb85","Type":"ContainerStarted","Data":"6ebb206d13102ae9c79f342071c13eb24c2d46da6cb2961945d04bdab199cf4c"} Jul 20 16:25:18.027475 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:18.027428 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" podStartSLOduration=1.8169216339999998 podStartE2EDuration="2.027416278s" totalImagesPullingTime="210.494644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:25:18.027113142 +0000 UTC m=+695.183930442" watchObservedRunningTime="2026-07-20 16:25:18.027416278 +0000 UTC m=+695.184233564" Jul 20 16:25:21.504047 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:21.504017 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:25:27.019361 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:27.019318 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:27.019850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:27.019394 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:27.035115 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:27.035082 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:25:27.069877 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:25:27.069845 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kmnxg" Jul 20 16:26:10.713326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:10.713244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:26:10.812068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:10.812033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:26:11.509541 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.509509 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-846b5978fd-wg7dw"] Jul 20 16:26:11.509721 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.509702 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-846b5978fd-wg7dw" podUID="5c84547b-ee98-40dd-babe-93556bc85c40" containerName="authorino" containerID="cri-o://75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8" gracePeriod=30 Jul 20 16:26:11.769779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.769723 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:26:11.810888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.810863 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgcs4\" (UniqueName: \"kubernetes.io/projected/5c84547b-ee98-40dd-babe-93556bc85c40-kube-api-access-wgcs4\") pod \"5c84547b-ee98-40dd-babe-93556bc85c40\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " Jul 20 16:26:11.811020 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.810896 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c84547b-ee98-40dd-babe-93556bc85c40-tls-cert\") pod \"5c84547b-ee98-40dd-babe-93556bc85c40\" (UID: \"5c84547b-ee98-40dd-babe-93556bc85c40\") " Jul 20 16:26:11.812963 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.812930 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c84547b-ee98-40dd-babe-93556bc85c40-kube-api-access-wgcs4" (OuterVolumeSpecName: "kube-api-access-wgcs4") pod "5c84547b-ee98-40dd-babe-93556bc85c40" (UID: "5c84547b-ee98-40dd-babe-93556bc85c40"). InnerVolumeSpecName "kube-api-access-wgcs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:26:11.822676 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.822651 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c84547b-ee98-40dd-babe-93556bc85c40-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5c84547b-ee98-40dd-babe-93556bc85c40" (UID: "5c84547b-ee98-40dd-babe-93556bc85c40"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:26:11.832533 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.832504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:26:11.912103 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.912078 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgcs4\" (UniqueName: \"kubernetes.io/projected/5c84547b-ee98-40dd-babe-93556bc85c40-kube-api-access-wgcs4\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:26:11.912103 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.912099 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c84547b-ee98-40dd-babe-93556bc85c40-tls-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:26:11.935192 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:11.935169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:26:12.280402 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.280370 2575 generic.go:356] "Generic (PLEG): container finished" podID="5c84547b-ee98-40dd-babe-93556bc85c40" containerID="75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8" exitCode=0 Jul 20 16:26:12.280574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.280418 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846b5978fd-wg7dw" Jul 20 16:26:12.280574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.280444 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846b5978fd-wg7dw" event={"ID":"5c84547b-ee98-40dd-babe-93556bc85c40","Type":"ContainerDied","Data":"75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8"} Jul 20 16:26:12.280574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.280481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846b5978fd-wg7dw" event={"ID":"5c84547b-ee98-40dd-babe-93556bc85c40","Type":"ContainerDied","Data":"012430d2be1e604ae2d239b1509c3a8c13f2f841c5b1897247364338da56f214"} Jul 20 16:26:12.280574 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.280499 2575 scope.go:117] "RemoveContainer" containerID="75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8" Jul 20 16:26:12.289443 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.289428 2575 scope.go:117] "RemoveContainer" containerID="75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8" Jul 20 16:26:12.289709 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:26:12.289690 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8\": container with ID starting with 75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8 not found: ID does not exist" containerID="75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8" Jul 20 16:26:12.289760 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.289720 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8"} err="failed to get container status \"75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8\": rpc error: code = NotFound desc = could not find container \"75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8\": container with ID starting with 75c176b44abc014a49d84341f7c018d8dfd1e5c4e1f599f179a55842c05290b8 not found: ID does not exist" Jul 20 16:26:12.302158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.302138 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-846b5978fd-wg7dw"] Jul 20 16:26:12.311921 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:12.306359 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-846b5978fd-wg7dw"] Jul 20 16:26:13.602182 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:26:13.602148 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c84547b-ee98-40dd-babe-93556bc85c40" path="/var/lib/kubelet/pods/5c84547b-ee98-40dd-babe-93556bc85c40/volumes" Jul 20 16:28:00.721097 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:00.721067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:15.445986 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:15.445952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:16.675089 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:16.675055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:20.775849 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:20.775816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:43.332301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:43.332216 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:28:43.333285 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:43.333263 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:28:43.337948 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:43.337927 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:28:43.338820 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:43.338800 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:28:51.118710 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:51.118674 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:51.235972 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:51.235936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:51.403881 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:51.403810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:57.086502 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:57.086471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:57.253585 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:57.253551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:57.337682 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:57.337590 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:28:57.436063 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:28:57.436030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:29:03.212903 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:29:03.212872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:29:03.313289 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:29:03.313258 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:29:56.099520 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:29:56.099485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:30:00.146471 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.146432 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln"] Jul 20 16:30:00.146896 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.146881 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c84547b-ee98-40dd-babe-93556bc85c40" containerName="authorino" Jul 20 16:30:00.146944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.146898 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c84547b-ee98-40dd-babe-93556bc85c40" containerName="authorino" Jul 20 16:30:00.146990 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.146980 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c84547b-ee98-40dd-babe-93556bc85c40" containerName="authorino" Jul 20 16:30:00.150187 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.150168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" Jul 20 16:30:00.152765 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.152742 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kpqps\"" Jul 20 16:30:00.159870 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.159853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" Jul 20 16:30:00.167024 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.167003 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln"] Jul 20 16:30:00.507489 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:00.507467 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln"] Jul 20 16:30:00.510036 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:30:00.510010 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf50b65f_eac3_4e17_8200_742c8fa5a830.slice/crio-e0302c1c1006a2e0574bc70c8648059a5a0ec496fb97e22838a048f458181393 WatchSource:0}: Error finding container e0302c1c1006a2e0574bc70c8648059a5a0ec496fb97e22838a048f458181393: Status 404 returned error can't find the container with id e0302c1c1006a2e0574bc70c8648059a5a0ec496fb97e22838a048f458181393 Jul 20 16:30:01.415384 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:01.415350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" event={"ID":"af50b65f-eac3-4e17-8200-742c8fa5a830","Type":"ContainerStarted","Data":"e0302c1c1006a2e0574bc70c8648059a5a0ec496fb97e22838a048f458181393"} Jul 20 16:30:03.427175 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:03.427143 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" event={"ID":"af50b65f-eac3-4e17-8200-742c8fa5a830","Type":"ContainerStarted","Data":"87126a20481f62ad89d7df7ceeee754edb33d75d07a534006be05eb9ac381d7b"} Jul 20 16:30:03.449733 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:03.449693 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" podStartSLOduration=0.908875454 podStartE2EDuration="3.449675231s" totalImagesPullingTime="2.540799777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:03.447711583 +0000 UTC m=+980.604528869" watchObservedRunningTime="2026-07-20 16:30:03.449675231 +0000 UTC m=+980.606492518" Jul 20 16:30:04.433083 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:04.433048 2575 generic.go:356] "Generic (PLEG): container finished" podID="af50b65f-eac3-4e17-8200-742c8fa5a830" containerID="87126a20481f62ad89d7df7ceeee754edb33d75d07a534006be05eb9ac381d7b" exitCode=0 Jul 20 16:30:04.433443 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:04.433092 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" event={"ID":"af50b65f-eac3-4e17-8200-742c8fa5a830","Type":"ContainerDied","Data":"87126a20481f62ad89d7df7ceeee754edb33d75d07a534006be05eb9ac381d7b"} Jul 20 16:30:05.580363 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:05.580341 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" Jul 20 16:30:06.444171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:06.444095 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" Jul 20 16:30:06.444171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:06.444132 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742750-8tcln" event={"ID":"af50b65f-eac3-4e17-8200-742c8fa5a830","Type":"ContainerDied","Data":"e0302c1c1006a2e0574bc70c8648059a5a0ec496fb97e22838a048f458181393"} Jul 20 16:30:06.444386 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:30:06.444180 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0302c1c1006a2e0574bc70c8648059a5a0ec496fb97e22838a048f458181393" Jul 20 16:31:20.139324 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:31:20.139290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:31:20.240957 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:31:20.240923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:31:24.467558 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:31:24.467504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:33:06.307364 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:33:06.307275 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:33:25.074390 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:33:25.074356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:33:43.365098 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:33:43.365074 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:33:43.366006 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:33:43.365988 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:33:43.377373 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:33:43.377352 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:33:43.378268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:33:43.378247 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:36:58.375990 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:36:58.375956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:37:01.307994 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:37:01.307964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:37:27.695320 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:37:27.695279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:37:28.838019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:37:28.837984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:38:08.041580 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:08.041501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:38:32.472349 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:32.472313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:38:32.573725 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:32.573691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:38:39.115473 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:39.115436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:38:43.405194 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:43.405170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:38:43.408768 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:43.408742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:38:43.411155 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:43.411135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:38:43.414019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:38:43.413997 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:40:43.844867 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:40:43.844773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:40:56.028301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:40:56.028265 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:04.133988 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:04.133945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:09.073299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:09.073261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:12.237800 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:12.237765 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:12.336711 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:12.336660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:12.727856 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:12.727828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:18.329205 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:18.329174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:18.388395 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:18.388364 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:18.561773 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:18.561739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:18.896568 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:18.896541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:18.995676 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:18.995644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:21.073235 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:21.073201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:21.161231 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:21.161187 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:21.230798 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:21.230756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:21.491657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:21.491567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:21.752562 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:21.752475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:21.848739 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:21.848707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:41:57.196299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:41:57.196265 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:01.801758 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:01.801726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:03.010236 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.010194 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt"] Jul 20 16:42:03.010876 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.010856 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af50b65f-eac3-4e17-8200-742c8fa5a830" containerName="cleanup" Jul 20 16:42:03.010932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.010880 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="af50b65f-eac3-4e17-8200-742c8fa5a830" containerName="cleanup" Jul 20 16:42:03.011042 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.011029 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="af50b65f-eac3-4e17-8200-742c8fa5a830" containerName="cleanup" Jul 20 16:42:03.014240 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.014221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.016770 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.016751 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3d81c45c-gw-openshift-default-dockercfg-6kk4t\"" Jul 20 16:42:03.026153 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.026131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt"] Jul 20 16:42:03.193898 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.193861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-certs\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.193920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-socket\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.193953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-podinfo\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.193976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2xc\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-kube-api-access-jr2xc\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.194015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-envoy\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.194046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-token\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194076 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.194078 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-data\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.194148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-credential-socket\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.194301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.194175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istiod-ca-cert\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-data\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295316 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-credential-socket\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295316 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istiod-ca-cert\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295316 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-certs\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295485 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-socket\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295485 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-podinfo\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295485 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2xc\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-kube-api-access-jr2xc\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295485 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-data\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295485 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-envoy\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295782 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-token\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295782 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295523 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-credential-socket\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295782 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-certs\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.295782 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-socket\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.296029 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.295969 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istiod-ca-cert\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.297778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.297758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-envoy\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.297883 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.297869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-podinfo\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.303601 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.303579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-token\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.303727 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.303639 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2xc\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-kube-api-access-jr2xc\") pod \"e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.325566 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.325546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:03.467306 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.467268 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt"] Jul 20 16:42:03.467788 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:42:03.467755 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2190006_4bb1_4240_8e81_82b13c8a2ca2.slice/crio-6f39a878f41df051d50b8543ec4914ae201d7cd90db8a4a23a28908b83dcb7fa WatchSource:0}: Error finding container 6f39a878f41df051d50b8543ec4914ae201d7cd90db8a4a23a28908b83dcb7fa: Status 404 returned error can't find the container with id 6f39a878f41df051d50b8543ec4914ae201d7cd90db8a4a23a28908b83dcb7fa Jul 20 16:42:03.470509 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.470465 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:42:03.470580 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.470559 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:42:03.470651 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.470608 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:42:03.999438 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.999399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" event={"ID":"d2190006-4bb1-4240-8e81-82b13c8a2ca2","Type":"ContainerStarted","Data":"52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893"} Jul 20 16:42:03.999601 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:03.999458 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" event={"ID":"d2190006-4bb1-4240-8e81-82b13c8a2ca2","Type":"ContainerStarted","Data":"6f39a878f41df051d50b8543ec4914ae201d7cd90db8a4a23a28908b83dcb7fa"} Jul 20 16:42:04.020113 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:04.020068 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podStartSLOduration=2.020053709 podStartE2EDuration="2.020053709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:42:04.018441639 +0000 UTC m=+1701.175258926" watchObservedRunningTime="2026-07-20 16:42:04.020053709 +0000 UTC m=+1701.176870996" Jul 20 16:42:04.188464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:04.188427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:04.326685 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:04.326657 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:04.331687 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:04.331660 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:05.004643 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:05.004592 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:05.005644 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:05.005603 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:05.514425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:05.514390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:05.682521 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:05.682486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:05.824608 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:05.824530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:06.178925 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:06.178822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:06.279611 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:06.279573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:20.006251 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.006218 2575 patch_prober.go:28] interesting pod/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:42:20.006681 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.006296 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:42:20.091301 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.091270 2575 generic.go:356] "Generic (PLEG): container finished" podID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerID="52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893" exitCode=0 Jul 20 16:42:20.091456 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.091348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" event={"ID":"d2190006-4bb1-4240-8e81-82b13c8a2ca2","Type":"ContainerDied","Data":"52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893"} Jul 20 16:42:20.091805 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.091787 2575 scope.go:117] "RemoveContainer" containerID="52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893" Jul 20 16:42:20.092810 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.092781 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:42:20.092873 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.092852 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:42:20.092913 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:20.092884 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:42:21.098268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:21.098235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" event={"ID":"d2190006-4bb1-4240-8e81-82b13c8a2ca2","Type":"ContainerStarted","Data":"8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245"} Jul 20 16:42:21.326071 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:21.326031 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:21.326300 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:21.326277 2575 patch_prober.go:28] interesting pod/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:42:21.326392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:21.326373 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:42:22.326287 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:22.326251 2575 patch_prober.go:28] interesting pod/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:42:22.326719 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:22.326311 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:42:23.326143 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:23.326109 2575 patch_prober.go:28] interesting pod/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:42:23.326323 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:23.326168 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:42:24.326279 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:24.326243 2575 patch_prober.go:28] interesting pod/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:42:24.326455 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:24.326301 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:42:25.330151 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:25.330121 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:25.330555 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:25.330467 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:25.331251 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:25.331229 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:41.099874 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:41.099839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:45.611287 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:45.611246 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:45.740008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:45.739978 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt"] Jul 20 16:42:45.740220 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:45.740182 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" containerID="cri-o://8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245" gracePeriod=30 Jul 20 16:42:45.765436 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:45.765411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:45.972977 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:45.972893 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:46.323935 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:46.323903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:46.511908 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:46.511876 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:46.796195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:46.796162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:48.512597 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:48.512563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:48.615839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:48.615804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:48.695506 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:48.695470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:49.288939 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:49.288908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:49.387055 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:49.387026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:49.485842 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:49.485803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:42:51.001121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.001063 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:51.126377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126348 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istiod-ca-cert\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126510 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126389 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-socket\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126510 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126409 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-podinfo\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126510 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126428 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr2xc\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-kube-api-access-jr2xc\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126670 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126554 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-envoy\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126670 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126599 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-certs\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126682 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-token\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126719 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-credential-socket\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126724 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:42:51.126781 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126766 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:42:51.126996 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126821 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-data\") pod \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\" (UID: \"d2190006-4bb1-4240-8e81-82b13c8a2ca2\") " Jul 20 16:42:51.126996 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126933 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:42:51.126996 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.126977 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:42:51.127333 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.127250 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-credential-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.127333 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.127279 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istiod-ca-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.127333 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.127294 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.127333 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.127308 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-workload-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.127839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.127814 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:42:51.128742 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.128717 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-kube-api-access-jr2xc" (OuterVolumeSpecName: "kube-api-access-jr2xc") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "kube-api-access-jr2xc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:42:51.128841 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.128774 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:42:51.128841 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.128821 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:42:51.128916 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.128823 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2190006-4bb1-4240-8e81-82b13c8a2ca2" (UID: "d2190006-4bb1-4240-8e81-82b13c8a2ca2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:42:51.228565 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.228542 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-data\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.228565 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.228564 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-podinfo\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.228714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.228574 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr2xc\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-kube-api-access-jr2xc\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.228714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.228583 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-envoy\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.228714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.228592 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2190006-4bb1-4240-8e81-82b13c8a2ca2-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:42:51.250839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.250817 2575 generic.go:356] "Generic (PLEG): container finished" podID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerID="8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245" exitCode=0 Jul 20 16:42:51.250937 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.250864 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" Jul 20 16:42:51.250937 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.250912 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" event={"ID":"d2190006-4bb1-4240-8e81-82b13c8a2ca2","Type":"ContainerDied","Data":"8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245"} Jul 20 16:42:51.251008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.250965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt" event={"ID":"d2190006-4bb1-4240-8e81-82b13c8a2ca2","Type":"ContainerDied","Data":"6f39a878f41df051d50b8543ec4914ae201d7cd90db8a4a23a28908b83dcb7fa"} Jul 20 16:42:51.251008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.250989 2575 scope.go:117] "RemoveContainer" containerID="8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245" Jul 20 16:42:51.260207 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.260193 2575 scope.go:117] "RemoveContainer" containerID="52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893" Jul 20 16:42:51.267850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.267833 2575 scope.go:117] "RemoveContainer" containerID="8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245" Jul 20 16:42:51.268086 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:42:51.268066 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245\": container with ID starting with 8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245 not found: ID does not exist" containerID="8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245" Jul 20 16:42:51.268159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.268096 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245"} err="failed to get container status \"8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245\": rpc error: code = NotFound desc = could not find container \"8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245\": container with ID starting with 8e3db0dd4597196d210dc70fe9e9d80d76f454f8ea065e955c64ddc48f5f7245 not found: ID does not exist" Jul 20 16:42:51.268159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.268118 2575 scope.go:117] "RemoveContainer" containerID="52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893" Jul 20 16:42:51.268375 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:42:51.268356 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893\": container with ID starting with 52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893 not found: ID does not exist" containerID="52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893" Jul 20 16:42:51.268416 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.268381 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893"} err="failed to get container status \"52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893\": rpc error: code = NotFound desc = could not find container \"52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893\": container with ID starting with 52c459407147907e23fed582d0a04e7f62f5ed445ed76173c8c590a0f52e0893 not found: ID does not exist" Jul 20 16:42:51.274865 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.274845 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt"] Jul 20 16:42:51.278171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.278151 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3d81c45c-gw-openshift-default-57fc5b7c8c-2mlzt"] Jul 20 16:42:51.602265 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:42:51.602229 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" path="/var/lib/kubelet/pods/d2190006-4bb1-4240-8e81-82b13c8a2ca2/volumes" Jul 20 16:43:25.233136 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:25.233087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:29.294543 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:29.294507 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:30.484953 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:30.484919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:30.706660 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:30.706630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:30.980692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:30.980657 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:31.222008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.221964 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll"] Jul 20 16:43:31.222551 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.222530 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" Jul 20 16:43:31.222641 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.222555 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" Jul 20 16:43:31.222641 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.222609 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" Jul 20 16:43:31.222758 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.222645 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" Jul 20 16:43:31.222758 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.222750 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" Jul 20 16:43:31.226268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.226247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.229099 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.229072 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1172f5be-openshift-default-dockercfg-lxvsv\"" Jul 20 16:43:31.240409 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.240387 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll"] Jul 20 16:43:31.246267 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.246244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:31.357168 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-data\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-socket\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-envoy\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-podinfo\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357277 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-credential-socket\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-token\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357319 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istiod-ca-cert\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357519 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-certs\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.357519 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.357417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pqcd\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-kube-api-access-5pqcd\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458164 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pqcd\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-kube-api-access-5pqcd\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458338 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-data\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458338 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-socket\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458338 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-envoy\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458338 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-podinfo\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458552 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-credential-socket\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458552 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-token\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458552 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istiod-ca-cert\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458552 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-certs\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458783 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-data\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458783 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-socket\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458896 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458867 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-certs\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.458974 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.458895 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-credential-socket\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.459364 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.459333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istiod-ca-cert\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.460804 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.460778 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-envoy\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.460967 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.460952 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-podinfo\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.466657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.466613 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pqcd\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-kube-api-access-5pqcd\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.466657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.466644 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-token\") pod \"e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.535943 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.535921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:31.647793 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.647759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:31.679148 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.679120 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll"] Jul 20 16:43:31.680165 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:43:31.680139 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218a0af7_4f07_4d22_91f2_4d4cb8e20595.slice/crio-0a047f8278802ccd3a100944ae7a611d4769d5b0410be3c95d9eac2ab1d95386 WatchSource:0}: Error finding container 0a047f8278802ccd3a100944ae7a611d4769d5b0410be3c95d9eac2ab1d95386: Status 404 returned error can't find the container with id 0a047f8278802ccd3a100944ae7a611d4769d5b0410be3c95d9eac2ab1d95386 Jul 20 16:43:31.685022 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.684976 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:43:31.685111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.685055 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:43:31.685111 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:31.685092 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:43:32.468310 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:32.468272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" event={"ID":"218a0af7-4f07-4d22-91f2-4d4cb8e20595","Type":"ContainerStarted","Data":"a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c"} Jul 20 16:43:32.468483 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:32.468360 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" event={"ID":"218a0af7-4f07-4d22-91f2-4d4cb8e20595","Type":"ContainerStarted","Data":"0a047f8278802ccd3a100944ae7a611d4769d5b0410be3c95d9eac2ab1d95386"} Jul 20 16:43:32.488926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:32.488885 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" podStartSLOduration=1.488872633 podStartE2EDuration="1.488872633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:43:32.48803245 +0000 UTC m=+1789.644849736" watchObservedRunningTime="2026-07-20 16:43:32.488872633 +0000 UTC m=+1789.645689919" Jul 20 16:43:32.537059 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:32.537032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:32.541840 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:32.541819 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:33.473578 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:33.473547 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:33.474463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:33.474446 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:33.844123 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:33.844086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:33.929332 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:33.929286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:34.013285 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:34.013253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:34.118200 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:34.118131 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:34.506804 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:34.506705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:34.608200 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:34.608158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:38.407929 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:38.407815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:38.508906 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:38.508879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:43.436193 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:43.436170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:43:43.441195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:43.441171 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:43:43.441722 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:43.441700 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:43:43.465778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:43.465756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:43:47.541799 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:47.541759 2575 generic.go:356] "Generic (PLEG): container finished" podID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerID="a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c" exitCode=0 Jul 20 16:43:47.542188 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:47.541830 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" event={"ID":"218a0af7-4f07-4d22-91f2-4d4cb8e20595","Type":"ContainerDied","Data":"a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c"} Jul 20 16:43:47.542230 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:47.542201 2575 scope.go:117] "RemoveContainer" containerID="a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c" Jul 20 16:43:47.543172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:47.543073 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:43:47.543172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:47.543136 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:43:47.543172 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:47.543168 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:43:48.474376 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:48.474338 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:48.552765 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:48.552714 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" event={"ID":"218a0af7-4f07-4d22-91f2-4d4cb8e20595","Type":"ContainerStarted","Data":"e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6"} Jul 20 16:43:49.536484 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:49.536448 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:49.537532 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:49.537510 2575 patch_prober.go:28] interesting pod/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:43:49.537606 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:49.537570 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:43:50.536924 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:50.536890 2575 patch_prober.go:28] interesting pod/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:43:50.537303 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:50.536942 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:43:51.537366 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:51.537329 2575 patch_prober.go:28] interesting pod/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:43:51.537785 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:51.537382 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:43:52.541121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:52.541084 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:52.541606 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:52.541479 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:52.542116 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:52.542094 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:43:55.472867 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:55.472832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:43:55.573876 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:43:55.573844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:09.231749 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:09.231718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:13.812472 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:13.812437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:13.958421 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:13.958389 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll"] Jul 20 16:44:13.958675 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:13.958648 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" containerID="cri-o://e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6" gracePeriod=30 Jul 20 16:44:13.980654 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:13.980604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:14.390481 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:14.390448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:14.701348 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:14.701262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:14.816596 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:14.816554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:14.928556 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:14.928523 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:16.399269 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:16.399238 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:18.093237 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:18.093206 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:18.197034 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:18.197007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:19.202926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.202907 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:44:19.267865 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.267843 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pqcd\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-kube-api-access-5pqcd\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.267999 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.267899 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-envoy\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.267999 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.267920 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-data\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.267999 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.267946 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istiod-ca-cert\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.267999 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.267966 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-credential-socket\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.267999 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.267986 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-podinfo\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.268294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268005 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-token\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.268294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268053 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-socket\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.268294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268075 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-certs\") pod \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\" (UID: \"218a0af7-4f07-4d22-91f2-4d4cb8e20595\") " Jul 20 16:44:19.268294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268235 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:44:19.268491 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268372 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-credential-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.268491 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268390 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:44:19.268491 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268348 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:44:19.268663 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268539 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:44:19.268964 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.268943 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-data" (OuterVolumeSpecName: "istio-data") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:44:19.270229 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.270197 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:44:19.270357 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.270334 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-token" (OuterVolumeSpecName: "istio-token") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:44:19.270494 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.270473 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:44:19.270588 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.270490 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-kube-api-access-5pqcd" (OuterVolumeSpecName: "kube-api-access-5pqcd") pod "218a0af7-4f07-4d22-91f2-4d4cb8e20595" (UID: "218a0af7-4f07-4d22-91f2-4d4cb8e20595"). InnerVolumeSpecName "kube-api-access-5pqcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:44:19.369456 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369433 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-envoy\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369456 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369453 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-data\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369463 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istiod-ca-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369472 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-podinfo\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369480 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369488 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369495 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/218a0af7-4f07-4d22-91f2-4d4cb8e20595-workload-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.369598 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.369503 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pqcd\" (UniqueName: \"kubernetes.io/projected/218a0af7-4f07-4d22-91f2-4d4cb8e20595-kube-api-access-5pqcd\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:44:19.711001 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.710971 2575 generic.go:356] "Generic (PLEG): container finished" podID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerID="e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6" exitCode=0 Jul 20 16:44:19.711152 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.711015 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" event={"ID":"218a0af7-4f07-4d22-91f2-4d4cb8e20595","Type":"ContainerDied","Data":"e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6"} Jul 20 16:44:19.711152 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.711026 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" Jul 20 16:44:19.711152 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.711058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll" event={"ID":"218a0af7-4f07-4d22-91f2-4d4cb8e20595","Type":"ContainerDied","Data":"0a047f8278802ccd3a100944ae7a611d4769d5b0410be3c95d9eac2ab1d95386"} Jul 20 16:44:19.711152 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.711079 2575 scope.go:117] "RemoveContainer" containerID="e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6" Jul 20 16:44:19.719940 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.719919 2575 scope.go:117] "RemoveContainer" containerID="a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c" Jul 20 16:44:19.728493 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.728476 2575 scope.go:117] "RemoveContainer" containerID="e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6" Jul 20 16:44:19.728768 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:44:19.728749 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6\": container with ID starting with e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6 not found: ID does not exist" containerID="e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6" Jul 20 16:44:19.728850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.728779 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6"} err="failed to get container status \"e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6\": rpc error: code = NotFound desc = could not find container \"e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6\": container with ID starting with e39050b96d2d7b533807c8efe5b352b658bece01e41ed6380db6be37d58e32b6 not found: ID does not exist" Jul 20 16:44:19.728850 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.728802 2575 scope.go:117] "RemoveContainer" containerID="a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c" Jul 20 16:44:19.729054 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:44:19.729035 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c\": container with ID starting with a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c not found: ID does not exist" containerID="a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c" Jul 20 16:44:19.729109 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.729061 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c"} err="failed to get container status \"a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c\": rpc error: code = NotFound desc = could not find container \"a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c\": container with ID starting with a687610efbe7968e7befd0bd2620f3b079686d75bd2a24fd9f062af1b86cff4c not found: ID does not exist" Jul 20 16:44:19.729956 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.729937 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll"] Jul 20 16:44:19.733682 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:19.733662 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1172f5be-openshift-default-5c9b9bd879-dq4ll"] Jul 20 16:44:21.604078 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:21.604043 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" path="/var/lib/kubelet/pods/218a0af7-4f07-4d22-91f2-4d4cb8e20595/volumes" Jul 20 16:44:22.104802 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:22.104770 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:22.164854 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:22.164826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:22.235590 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:22.235563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:22.349657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:22.349603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:22.458131 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:22.458059 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:22.835959 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:22.835930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:47.390401 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:47.390364 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:47.447047 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:47.447020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:48.856371 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:48.856337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:55.031670 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:55.031612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:55.144354 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:55.144293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:44:55.233134 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:44:55.233098 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:04.081363 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:04.081331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:11.251716 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:11.251580 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:17.125826 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:17.125787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:17.411197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:17.411117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:17.508956 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:17.508922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:27.916449 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:27.916416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:28.759200 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:28.759111 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:34.791582 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:34.791554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:35.048936 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:35.048865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:35.150023 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:35.149996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:35.933124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:35.933084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:36.029092 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:36.029057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:36.305418 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:36.305389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:42.866310 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:42.866279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:48.678429 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:48.678391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:48.778975 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:48.778942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:49.332606 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:49.332573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:54.966481 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:54.966445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:55.031989 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:55.031958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:55.209842 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:55.209815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:55.534102 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:55.534051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:55.645997 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:55.645968 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:58.993753 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:58.993722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:59.094260 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:59.094230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:59.243080 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:59.243051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:59.417832 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:59.417799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:59.770201 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:59.770175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:45:59.870136 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:45:59.870105 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:03.470199 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:03.470168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:04.117571 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:04.117529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:04.210802 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:04.210773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:04.514517 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:04.514488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:10.229880 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:10.229844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:10.328278 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:10.328248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:21.074109 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:21.074075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:25.655852 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:25.655820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:26.041435 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:26.041398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:31.710976 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:31.710933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:31.776062 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:31.776032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:31.962714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:31.962640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:32.193039 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:32.193008 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:32.317824 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:32.317783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:32.415832 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:32.415801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:32.532210 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:32.532182 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:38.058392 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:38.058311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:38.130471 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:38.130445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:38.208394 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:38.208363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:38.404389 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:38.404315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:44.038326 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:44.038294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:44.138663 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:44.138608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:50.786664 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:50.786636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:51.063537 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.063464 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94"] Jul 20 16:46:51.063907 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.063893 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" Jul 20 16:46:51.063961 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.063910 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" Jul 20 16:46:51.063961 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.063923 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" Jul 20 16:46:51.063961 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.063929 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" Jul 20 16:46:51.064054 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.063999 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" Jul 20 16:46:51.064054 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.064009 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2190006-4bb1-4240-8e81-82b13c8a2ca2" containerName="istio-proxy" Jul 20 16:46:51.064054 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.064014 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="218a0af7-4f07-4d22-91f2-4d4cb8e20595" containerName="istio-proxy" Jul 20 16:46:51.067146 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.067124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.071775 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.071755 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3b97b792-openshift-default-dockercfg-ssj5b\"" Jul 20 16:46:51.101472 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.101451 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94"] Jul 20 16:46:51.138746 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.138726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:51.191679 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-credential-socket\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.191858 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-envoy\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.191858 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56987149-6aee-493f-9b31-87cbf780cc57-istiod-ca-cert\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.191858 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-socket\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.191858 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dxv7\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-kube-api-access-6dxv7\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.192018 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56987149-6aee-493f-9b31-87cbf780cc57-istio-podinfo\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.192018 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-data\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.192018 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.191978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-istio-token\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.192127 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.192022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-certs\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.292509 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-certs\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.292700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-credential-socket\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.292700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-envoy\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.292700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56987149-6aee-493f-9b31-87cbf780cc57-istiod-ca-cert\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.292700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-socket\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.292700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dxv7\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-kube-api-access-6dxv7\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293050 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56987149-6aee-493f-9b31-87cbf780cc57-istio-podinfo\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293050 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-data\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293050 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-istio-token\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293050 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.292972 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-certs\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293050 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.293039 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-socket\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293300 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.293049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-credential-socket\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293300 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.293236 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-data\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.293371 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.293322 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56987149-6aee-493f-9b31-87cbf780cc57-istiod-ca-cert\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.294950 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.294929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-envoy\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.295181 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.295160 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56987149-6aee-493f-9b31-87cbf780cc57-istio-podinfo\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.301258 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.301234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-istio-token\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.301896 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.301875 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dxv7\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-kube-api-access-6dxv7\") pod \"e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.312449 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.312427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:51.377479 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.377426 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:51.515487 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.515457 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94"] Jul 20 16:46:51.516571 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:46:51.516545 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56987149_6aee_493f_9b31_87cbf780cc57.slice/crio-19a723f9f31088e28de20f0603d29d72d7f0170027cfca0f19a2eb7d0543a39f WatchSource:0}: Error finding container 19a723f9f31088e28de20f0603d29d72d7f0170027cfca0f19a2eb7d0543a39f: Status 404 returned error can't find the container with id 19a723f9f31088e28de20f0603d29d72d7f0170027cfca0f19a2eb7d0543a39f Jul 20 16:46:51.518664 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.518610 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:46:51.518778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.518705 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:46:51.518778 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:51.518753 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:46:52.463586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:52.463549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" event={"ID":"56987149-6aee-493f-9b31-87cbf780cc57","Type":"ContainerStarted","Data":"39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503"} Jul 20 16:46:52.464063 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:52.463613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" event={"ID":"56987149-6aee-493f-9b31-87cbf780cc57","Type":"ContainerStarted","Data":"19a723f9f31088e28de20f0603d29d72d7f0170027cfca0f19a2eb7d0543a39f"} Jul 20 16:46:52.484359 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:52.484313 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podStartSLOduration=1.4842994 podStartE2EDuration="1.4842994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:46:52.483144354 +0000 UTC m=+1989.639961653" watchObservedRunningTime="2026-07-20 16:46:52.4842994 +0000 UTC m=+1989.641116686" Jul 20 16:46:53.377919 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:53.377884 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:53.383213 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:53.383190 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:53.468026 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:53.467995 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:53.468718 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:53.468701 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:46:54.376605 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:54.376574 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:54.481797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:54.481738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:54.575516 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:54.575478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:54.681268 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:54.681183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:55.163794 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:55.163762 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:55.264845 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:55.264815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:46:58.874841 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:46:58.874790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:47:06.935007 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:06.934968 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:47:08.469150 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.469064 2575 patch_prober.go:28] interesting pod/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:47:08.469150 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.469119 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:47:08.544714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.544680 2575 generic.go:356] "Generic (PLEG): container finished" podID="56987149-6aee-493f-9b31-87cbf780cc57" containerID="39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503" exitCode=0 Jul 20 16:47:08.544862 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.544752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" event={"ID":"56987149-6aee-493f-9b31-87cbf780cc57","Type":"ContainerDied","Data":"39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503"} Jul 20 16:47:08.545144 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.545124 2575 scope.go:117] "RemoveContainer" containerID="39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503" Jul 20 16:47:08.546091 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.546063 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:47:08.546211 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.546147 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:47:08.546211 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:08.546192 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:47:09.551500 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:09.551459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" event={"ID":"56987149-6aee-493f-9b31-87cbf780cc57","Type":"ContainerStarted","Data":"641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136"} Jul 20 16:47:10.378521 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:10.378478 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:47:10.378774 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:10.378694 2575 patch_prober.go:28] interesting pod/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:47:10.378774 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:10.378748 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:47:11.378345 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:11.378307 2575 patch_prober.go:28] interesting pod/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:47:11.378797 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:11.378362 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:47:12.378311 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:12.378271 2575 patch_prober.go:28] interesting pod/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:47:12.378485 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:12.378336 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:47:13.378453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:13.378414 2575 patch_prober.go:28] interesting pod/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:47:13.378666 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:13.378474 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:47:14.382060 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:14.382029 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:47:14.382525 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:14.382371 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:47:14.382978 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:14.382957 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:47:47.876887 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:47.876854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:47:51.842019 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:51.841985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:47:52.390586 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:52.390557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:47:54.582967 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:54.582935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:47:59.600562 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:47:59.600530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:36.240108 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:36.240075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:37.158079 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:37.158041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:39.313729 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:39.313698 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:39.422341 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:39.422309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:42.744018 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:42.743985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:42.844352 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:42.844317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:43.003488 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.003399 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94"] Jul 20 16:48:43.003727 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.003701 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" containerID="cri-o://641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136" gracePeriod=30 Jul 20 16:48:43.031874 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.031841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:43.273631 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.273595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:43.467066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.467041 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:48:43.472330 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.472308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:48:43.499190 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.499170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:48:43.504255 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:43.504236 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:48:44.384949 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:44.384903 2575 patch_prober.go:28] interesting pod/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 16:48:44.385339 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:44.384978 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:48:44.402290 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:44.402262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:44.497634 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:44.497595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:44.594923 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:44.594889 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:45.314768 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:45.314738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:45.415805 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:45.415777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:45.516074 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:45.516045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:47.008177 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:47.008145 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:48.258353 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.258327 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:48:48.271955 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.271892 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-envoy\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272058 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272006 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-socket\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272067 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56987149-6aee-493f-9b31-87cbf780cc57-istiod-ca-cert\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272090 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dxv7\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-kube-api-access-6dxv7\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272107 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-certs\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272138 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56987149-6aee-493f-9b31-87cbf780cc57-istio-podinfo\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272171 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-data\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272217 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-istio-token\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272245 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-credential-socket\") pod \"56987149-6aee-493f-9b31-87cbf780cc57\" (UID: \"56987149-6aee-493f-9b31-87cbf780cc57\") " Jul 20 16:48:48.272294 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272256 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:48:48.272546 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272445 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:48:48.272604 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272560 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.272604 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272579 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-workload-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.272740 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272677 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56987149-6aee-493f-9b31-87cbf780cc57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:48:48.272740 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.272677 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:48:48.273215 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.273188 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-data" (OuterVolumeSpecName: "istio-data") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:48:48.274195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.274166 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:48:48.274297 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.274200 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56987149-6aee-493f-9b31-87cbf780cc57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:48:48.274419 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.274307 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-kube-api-access-6dxv7" (OuterVolumeSpecName: "kube-api-access-6dxv7") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "kube-api-access-6dxv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:48:48.274419 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.274357 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-istio-token" (OuterVolumeSpecName: "istio-token") pod "56987149-6aee-493f-9b31-87cbf780cc57" (UID: "56987149-6aee-493f-9b31-87cbf780cc57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:48:48.373822 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373797 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.373951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373825 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-credential-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.373951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373839 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-envoy\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.373951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373850 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56987149-6aee-493f-9b31-87cbf780cc57-istiod-ca-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.373951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373862 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dxv7\" (UniqueName: \"kubernetes.io/projected/56987149-6aee-493f-9b31-87cbf780cc57-kube-api-access-6dxv7\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.373951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373874 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56987149-6aee-493f-9b31-87cbf780cc57-istio-podinfo\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:48.373951 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:48.373888 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56987149-6aee-493f-9b31-87cbf780cc57-istio-data\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:48:49.066147 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.066110 2575 generic.go:356] "Generic (PLEG): container finished" podID="56987149-6aee-493f-9b31-87cbf780cc57" containerID="641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136" exitCode=0 Jul 20 16:48:49.066315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.066156 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" Jul 20 16:48:49.066315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.066196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" event={"ID":"56987149-6aee-493f-9b31-87cbf780cc57","Type":"ContainerDied","Data":"641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136"} Jul 20 16:48:49.066315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.066253 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94" event={"ID":"56987149-6aee-493f-9b31-87cbf780cc57","Type":"ContainerDied","Data":"19a723f9f31088e28de20f0603d29d72d7f0170027cfca0f19a2eb7d0543a39f"} Jul 20 16:48:49.066315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.066276 2575 scope.go:117] "RemoveContainer" containerID="641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136" Jul 20 16:48:49.075849 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.075831 2575 scope.go:117] "RemoveContainer" containerID="39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503" Jul 20 16:48:49.083759 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.083743 2575 scope.go:117] "RemoveContainer" containerID="641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136" Jul 20 16:48:49.084005 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:48:49.083990 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136\": container with ID starting with 641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136 not found: ID does not exist" containerID="641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136" Jul 20 16:48:49.084041 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.084013 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136"} err="failed to get container status \"641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136\": rpc error: code = NotFound desc = could not find container \"641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136\": container with ID starting with 641609fd9fdb3db220c8d423551f27e8363baf93dec9a5f665c135ca38c1b136 not found: ID does not exist" Jul 20 16:48:49.084041 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.084028 2575 scope.go:117] "RemoveContainer" containerID="39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503" Jul 20 16:48:49.084239 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:48:49.084222 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503\": container with ID starting with 39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503 not found: ID does not exist" containerID="39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503" Jul 20 16:48:49.084275 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.084245 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503"} err="failed to get container status \"39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503\": rpc error: code = NotFound desc = could not find container \"39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503\": container with ID starting with 39dfd1c7362044400d9452c58499dbfc14b6c7a37fb698f0629accd528ddc503 not found: ID does not exist" Jul 20 16:48:49.088904 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.088884 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94"] Jul 20 16:48:49.094393 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.094375 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3b97b792-openshift-default-6f6846797f-hhq94"] Jul 20 16:48:49.602920 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:49.602892 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56987149-6aee-493f-9b31-87cbf780cc57" path="/var/lib/kubelet/pods/56987149-6aee-493f-9b31-87cbf780cc57/volumes" Jul 20 16:48:52.916842 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:52.916809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:52.976188 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:52.976160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:53.602053 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:53.602014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:59.697660 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:59.697609 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:59.774423 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:59.774389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:48:59.969377 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:48:59.969304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:00.082871 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:00.082844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:10.472702 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:10.472663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:10.862925 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:10.862897 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:32.275177 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:32.275136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:38.457505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:38.457434 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:38.557946 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:38.557917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:39.223939 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:39.223909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:39.599202 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:39.599170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:39.699894 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:39.699862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:42.119812 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:42.119781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:42.285254 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:42.285226 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:42.395090 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:42.395014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:42.770530 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:42.770502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:42.935005 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:42.934976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:43.049606 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:43.049522 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:46.664976 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:46.664942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:47.102279 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.102248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:47.458918 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.458839 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv"] Jul 20 16:49:47.459355 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.459337 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" Jul 20 16:49:47.459447 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.459358 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" Jul 20 16:49:47.459447 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.459381 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" Jul 20 16:49:47.459447 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.459389 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" Jul 20 16:49:47.459595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.459509 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" Jul 20 16:49:47.459595 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.459527 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="56987149-6aee-493f-9b31-87cbf780cc57" containerName="istio-proxy" Jul 20 16:49:47.463900 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.463880 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.475651 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.474050 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-59dc77-openshift-default-dockercfg-9mzns\"" Jul 20 16:49:47.485261 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.485236 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv"] Jul 20 16:49:47.523208 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.523181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:47.559494 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-socket\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559638 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99e68d5-20c8-4ac2-811b-458678b17394-istio-podinfo\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559638 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-credential-socket\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559638 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-envoy\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99e68d5-20c8-4ac2-811b-458678b17394-istiod-ca-cert\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-data\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-istio-token\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-certs\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.559944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.559796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7tm8\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-kube-api-access-t7tm8\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661157 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-socket\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661157 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99e68d5-20c8-4ac2-811b-458678b17394-istio-podinfo\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661157 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-credential-socket\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661393 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-envoy\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661450 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99e68d5-20c8-4ac2-811b-458678b17394-istiod-ca-cert\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661450 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-data\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661548 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-istio-token\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661548 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661502 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-socket\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661548 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-certs\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661765 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-credential-socket\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661765 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7tm8\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-kube-api-access-t7tm8\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-certs\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.661941 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.661922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-data\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.662103 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.662085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99e68d5-20c8-4ac2-811b-458678b17394-istiod-ca-cert\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.663746 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.663726 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-envoy\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.664018 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.664001 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99e68d5-20c8-4ac2-811b-458678b17394-istio-podinfo\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.685195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.685166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-istio-token\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.686263 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.686233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7tm8\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-kube-api-access-t7tm8\") pod \"e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.722539 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.722478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:47.774137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.774114 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:47.925226 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.925198 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv"] Jul 20 16:49:47.928709 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:49:47.928680 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99e68d5_20c8_4ac2_811b_458678b17394.slice/crio-97a42ca960ac2c36be63b91b12771d4192b6fb0a19744bff579776588df21aea WatchSource:0}: Error finding container 97a42ca960ac2c36be63b91b12771d4192b6fb0a19744bff579776588df21aea: Status 404 returned error can't find the container with id 97a42ca960ac2c36be63b91b12771d4192b6fb0a19744bff579776588df21aea Jul 20 16:49:47.930824 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.930793 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:49:47.930882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.930854 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:49:47.930929 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:47.930883 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:49:48.376264 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:48.376227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" event={"ID":"f99e68d5-20c8-4ac2-811b-458678b17394","Type":"ContainerStarted","Data":"b363d7851955f44d69e99cf228e170014ed5b032e7d95d3a2a15ebbd03701f42"} Jul 20 16:49:48.376475 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:48.376285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" event={"ID":"f99e68d5-20c8-4ac2-811b-458678b17394","Type":"ContainerStarted","Data":"97a42ca960ac2c36be63b91b12771d4192b6fb0a19744bff579776588df21aea"} Jul 20 16:49:48.485416 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:48.485367 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podStartSLOduration=1.485352322 podStartE2EDuration="1.485352322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:49:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:49:48.473996092 +0000 UTC m=+2165.630813380" watchObservedRunningTime="2026-07-20 16:49:48.485352322 +0000 UTC m=+2165.642169609" Jul 20 16:49:48.775082 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:48.775054 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:48.779898 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:48.779874 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:49.381507 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:49.381480 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:49.382426 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:49.382404 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:49:50.986270 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:50.986241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:51.170365 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:51.170336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:51.353840 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:51.353812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:51.725456 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:51.725375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:52.151608 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:52.151578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:52.259931 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:52.259897 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:55.409353 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:55.409322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:49:57.544202 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:49:57.544139 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:05.139070 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:05.139039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:05.233675 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:05.233644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:05.423841 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:05.423767 2575 patch_prober.go:28] interesting pod/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:50:05.423841 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:05.423815 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 16:50:06.468609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:06.468511 2575 generic.go:356] "Generic (PLEG): container finished" podID="f99e68d5-20c8-4ac2-811b-458678b17394" containerID="b363d7851955f44d69e99cf228e170014ed5b032e7d95d3a2a15ebbd03701f42" exitCode=0 Jul 20 16:50:06.468609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:06.468587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" event={"ID":"f99e68d5-20c8-4ac2-811b-458678b17394","Type":"ContainerDied","Data":"b363d7851955f44d69e99cf228e170014ed5b032e7d95d3a2a15ebbd03701f42"} Jul 20 16:50:06.469109 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:06.468964 2575 scope.go:117] "RemoveContainer" containerID="b363d7851955f44d69e99cf228e170014ed5b032e7d95d3a2a15ebbd03701f42" Jul 20 16:50:06.469914 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:06.469884 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:50:06.469968 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:06.469956 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:50:06.470010 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:06.469993 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:50:07.476903 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:07.476863 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" event={"ID":"f99e68d5-20c8-4ac2-811b-458678b17394","Type":"ContainerStarted","Data":"9cd8b1aab9a6e8dfc0f03d04ce781fb5e50958faf7bf3ca59d46f3a55cdc8dee"} Jul 20 16:50:07.774649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:07.774588 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:50:07.774870 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:07.774845 2575 patch_prober.go:28] interesting pod/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:50:07.774953 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:07.774902 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:50:08.775133 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:08.775100 2575 patch_prober.go:28] interesting pod/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:50:08.775525 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:08.775152 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:50:09.775332 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:09.775293 2575 patch_prober.go:28] interesting pod/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:50:09.775763 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:09.775360 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:50:10.775335 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:10.775296 2575 patch_prober.go:28] interesting pod/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:50:10.775800 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:10.775362 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:50:11.777988 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:11.777953 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:50:11.778357 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:11.778221 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:50:11.778909 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:11.778892 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:50:12.256493 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:12.256418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:14.124577 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:14.124543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:14.223577 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:14.223549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:18.949437 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:18.949402 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:44.312695 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:44.312658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:45.258231 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:45.258201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:46.026657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:46.026601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:46.121424 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:46.121391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:54.341881 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:54.341832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:50:55.897101 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:50:55.897072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:00.453032 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:00.453001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:00.827578 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:00.827545 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:06.645062 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:06.644994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:06.709493 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:06.709450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:06.911197 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:06.911097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:07.187540 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:07.187459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:07.878012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:07.877977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:07.979376 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:07.979349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:17.720273 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:17.720245 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:22.331660 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:22.331602 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:22.697314 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:22.697235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:28.472086 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:28.472055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:28.538874 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:28.538836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:28.720069 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:28.720035 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv"] Jul 20 16:51:28.720328 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:28.720295 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" containerID="cri-o://9cd8b1aab9a6e8dfc0f03d04ce781fb5e50958faf7bf3ca59d46f3a55cdc8dee" gracePeriod=30 Jul 20 16:51:28.752224 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:28.752170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:28.960064 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:28.960034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:29.296882 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:29.296847 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:30.460297 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:30.460264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:30.564608 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:30.564577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:32.593645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:32.593599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:32.735085 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:32.735057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:32.916481 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:32.916401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:33.367643 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.367592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:33.555949 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.555914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:33.656440 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.656365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:33.904909 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.904873 2575 generic.go:356] "Generic (PLEG): container finished" podID="f99e68d5-20c8-4ac2-811b-458678b17394" containerID="9cd8b1aab9a6e8dfc0f03d04ce781fb5e50958faf7bf3ca59d46f3a55cdc8dee" exitCode=0 Jul 20 16:51:33.905077 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.905057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" event={"ID":"f99e68d5-20c8-4ac2-811b-458678b17394","Type":"ContainerDied","Data":"9cd8b1aab9a6e8dfc0f03d04ce781fb5e50958faf7bf3ca59d46f3a55cdc8dee"} Jul 20 16:51:33.905148 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.905130 2575 scope.go:117] "RemoveContainer" containerID="b363d7851955f44d69e99cf228e170014ed5b032e7d95d3a2a15ebbd03701f42" Jul 20 16:51:33.981188 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:33.981166 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:51:34.070708 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-certs\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.070827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070718 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-socket\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.070827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070740 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-envoy\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.070827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070759 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99e68d5-20c8-4ac2-811b-458678b17394-istiod-ca-cert\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.070827 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070797 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-istio-token\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.071017 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070934 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7tm8\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-kube-api-access-t7tm8\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.071017 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070983 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-data\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.071121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.070993 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:51:34.071121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071029 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-credential-socket\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.071121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071060 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99e68d5-20c8-4ac2-811b-458678b17394-istio-podinfo\") pod \"f99e68d5-20c8-4ac2-811b-458678b17394\" (UID: \"f99e68d5-20c8-4ac2-811b-458678b17394\") " Jul 20 16:51:34.071121 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071049 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:51:34.071329 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071305 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:51:34.071390 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071322 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f99e68d5-20c8-4ac2-811b-458678b17394-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:51:34.071506 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071482 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.071639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071510 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-workload-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.071639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071524 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99e68d5-20c8-4ac2-811b-458678b17394-istiod-ca-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.071639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071538 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-credential-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.071911 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.071884 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-data" (OuterVolumeSpecName: "istio-data") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:51:34.073046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.073021 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:51:34.073130 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.073063 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f99e68d5-20c8-4ac2-811b-458678b17394-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:51:34.073130 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.073107 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-istio-token" (OuterVolumeSpecName: "istio-token") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:51:34.073259 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.073240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-kube-api-access-t7tm8" (OuterVolumeSpecName: "kube-api-access-t7tm8") pod "f99e68d5-20c8-4ac2-811b-458678b17394" (UID: "f99e68d5-20c8-4ac2-811b-458678b17394"). InnerVolumeSpecName "kube-api-access-t7tm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:51:34.172944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.172889 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-data\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.172944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.172909 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99e68d5-20c8-4ac2-811b-458678b17394-istio-podinfo\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.172944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.172918 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99e68d5-20c8-4ac2-811b-458678b17394-istio-envoy\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.172944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.172926 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.172944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.172934 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7tm8\" (UniqueName: \"kubernetes.io/projected/f99e68d5-20c8-4ac2-811b-458678b17394-kube-api-access-t7tm8\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:51:34.911780 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.911748 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" Jul 20 16:51:34.911780 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.911769 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv" event={"ID":"f99e68d5-20c8-4ac2-811b-458678b17394","Type":"ContainerDied","Data":"97a42ca960ac2c36be63b91b12771d4192b6fb0a19744bff579776588df21aea"} Jul 20 16:51:34.912260 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.911832 2575 scope.go:117] "RemoveContainer" containerID="9cd8b1aab9a6e8dfc0f03d04ce781fb5e50958faf7bf3ca59d46f3a55cdc8dee" Jul 20 16:51:34.942680 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.942558 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv"] Jul 20 16:51:34.944673 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:34.944650 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-59dc77-openshift-default-77b58444d9-hxmcv"] Jul 20 16:51:35.602779 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:35.602738 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" path="/var/lib/kubelet/pods/f99e68d5-20c8-4ac2-811b-458678b17394/volumes" Jul 20 16:51:37.045187 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.045156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:37.506020 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.505931 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:37.772068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772037 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6"] Jul 20 16:51:37.772453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772440 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" Jul 20 16:51:37.772453 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772453 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" Jul 20 16:51:37.772562 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772466 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" Jul 20 16:51:37.772562 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772472 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" Jul 20 16:51:37.772562 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772547 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" Jul 20 16:51:37.772562 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.772555 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f99e68d5-20c8-4ac2-811b-458678b17394" containerName="istio-proxy" Jul 20 16:51:37.776809 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.776791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.780059 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.780043 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9f2d87-openshift-default-dockercfg-l2sv5\"" Jul 20 16:51:37.791649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.791607 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6"] Jul 20 16:51:37.811048 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.811020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:37.905940 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.905905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-credential-socket\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.905940 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.905941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-data\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.905964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-certs\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.906052 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-istio-token\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.906080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899381cf-6344-4939-84c2-61c7460098bf-istiod-ca-cert\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.906108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx9bj\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-kube-api-access-kx9bj\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.906156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-socket\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.906175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-envoy\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:37.906511 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:37.906228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899381cf-6344-4939-84c2-61c7460098bf-istio-podinfo\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007183 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-credential-socket\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007183 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-data\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-certs\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007315 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-istio-token\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899381cf-6344-4939-84c2-61c7460098bf-istiod-ca-cert\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx9bj\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-kube-api-access-kx9bj\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007434 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-socket\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007753 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-envoy\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007753 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899381cf-6344-4939-84c2-61c7460098bf-istio-podinfo\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007753 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007613 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-credential-socket\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007886 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007831 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-certs\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.007886 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.007872 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-data\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.008026 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.008005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-socket\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.008239 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.008216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899381cf-6344-4939-84c2-61c7460098bf-istiod-ca-cert\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.009924 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.009906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-envoy\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.010072 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.010054 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899381cf-6344-4939-84c2-61c7460098bf-istio-podinfo\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.015444 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.015425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-istio-token\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.015548 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.015451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx9bj\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-kube-api-access-kx9bj\") pod \"e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.087402 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.087319 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:38.232192 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.232166 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6"] Jul 20 16:51:38.234537 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:51:38.234512 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899381cf_6344_4939_84c2_61c7460098bf.slice/crio-716fae9946ac5ba8cedbfb2d0c2335dc4cbbf5291ad239ecad596231b82f6112 WatchSource:0}: Error finding container 716fae9946ac5ba8cedbfb2d0c2335dc4cbbf5291ad239ecad596231b82f6112: Status 404 returned error can't find the container with id 716fae9946ac5ba8cedbfb2d0c2335dc4cbbf5291ad239ecad596231b82f6112 Jul 20 16:51:38.237163 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.237124 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:51:38.237246 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.237203 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:51:38.237246 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.237230 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:51:38.775869 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.775834 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:38.935256 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.935218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" event={"ID":"899381cf-6344-4939-84c2-61c7460098bf","Type":"ContainerStarted","Data":"73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9"} Jul 20 16:51:38.935442 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.935288 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" event={"ID":"899381cf-6344-4939-84c2-61c7460098bf","Type":"ContainerStarted","Data":"716fae9946ac5ba8cedbfb2d0c2335dc4cbbf5291ad239ecad596231b82f6112"} Jul 20 16:51:38.957465 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:38.957417 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podStartSLOduration=1.95740169 podStartE2EDuration="1.95740169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:51:38.955079084 +0000 UTC m=+2276.111896405" watchObservedRunningTime="2026-07-20 16:51:38.95740169 +0000 UTC m=+2276.114218977" Jul 20 16:51:39.087966 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:39.087883 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:39.092793 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:39.092770 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:39.940071 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:39.940035 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:39.940926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:39.940909 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:40.955136 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:40.955102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:41.218006 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:41.217920 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:41.317333 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:41.317305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:41.455089 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:41.455052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:41.658888 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:41.658857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:41.757107 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:41.757081 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:42.578043 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:42.578009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:45.421137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:45.421103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:53.978267 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:53.978234 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:54.941179 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:54.941111 2575 patch_prober.go:28] interesting pod/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:51:54.941179 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:54.941170 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:51:55.022505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.022478 2575 generic.go:356] "Generic (PLEG): container finished" podID="899381cf-6344-4939-84c2-61c7460098bf" containerID="73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9" exitCode=0 Jul 20 16:51:55.022836 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.022549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" event={"ID":"899381cf-6344-4939-84c2-61c7460098bf","Type":"ContainerDied","Data":"73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9"} Jul 20 16:51:55.022946 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.022931 2575 scope.go:117] "RemoveContainer" containerID="73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9" Jul 20 16:51:55.023892 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.023865 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:51:55.023958 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.023939 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:51:55.023997 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.023969 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:51:55.036269 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:55.036237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:51:56.029217 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:56.029182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" event={"ID":"899381cf-6344-4939-84c2-61c7460098bf","Type":"ContainerStarted","Data":"f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b"} Jul 20 16:51:56.087600 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:56.087564 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:51:56.087803 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:56.087684 2575 patch_prober.go:28] interesting pod/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:51:56.087803 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:56.087737 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:51:57.088431 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:57.088398 2575 patch_prober.go:28] interesting pod/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:51:57.088947 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:57.088446 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:51:58.087991 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:58.087955 2575 patch_prober.go:28] interesting pod/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:51:58.088166 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:58.088008 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:51:59.088406 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:59.088369 2575 patch_prober.go:28] interesting pod/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:51:59.088898 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:51:59.088425 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:52:00.092211 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:00.092183 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:52:00.092657 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:00.092640 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:52:00.093318 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:00.093298 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:52:02.479604 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:02.479569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:02.579851 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:02.579824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:04.079191 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:04.079160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:04.181944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:04.181911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:09.338293 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:09.338266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:13.410243 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:13.410214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:16.178194 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:16.178156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:19.797171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:19.797142 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:19.866887 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:19.866827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:20.041278 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:20.041248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:20.266015 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:20.265987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:20.927943 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:20.927914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:21.028662 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:21.028614 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:36.026649 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:36.026605 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:40.490559 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:40.490529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:40.836511 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:40.836481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:46.445204 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:46.445167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:46.506709 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:46.506678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:46.679601 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:46.679569 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6"] Jul 20 16:52:46.679945 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:46.679916 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" containerID="cri-o://f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b" gracePeriod=30 Jul 20 16:52:46.704828 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:46.704758 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:46.920948 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:46.920911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:47.250008 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:47.249980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:47.568390 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:47.568355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:47.774343 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:47.774307 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:50.885804 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:50.885777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:50.973055 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:50.973025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:51.043609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:51.043579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:51.146082 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:51.146001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:51.591056 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:51.591022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:51.690088 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:51.690059 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:51.935500 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:51.935480 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:52:52.133542 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133472 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-certs\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133544 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-socket\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133565 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899381cf-6344-4939-84c2-61c7460098bf-istio-podinfo\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133595 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-data\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133610 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-envoy\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133659 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-credential-socket\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133707 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-istio-token\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133732 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx9bj\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-kube-api-access-kx9bj\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.133831 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133779 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899381cf-6344-4939-84c2-61c7460098bf-istiod-ca-cert\") pod \"899381cf-6344-4939-84c2-61c7460098bf\" (UID: \"899381cf-6344-4939-84c2-61c7460098bf\") " Jul 20 16:52:52.134299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133773 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:52:52.134299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.133900 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:52:52.134299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.134066 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:52:52.134299 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.134198 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899381cf-6344-4939-84c2-61c7460098bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:52:52.134526 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.134499 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:52:52.135894 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.135856 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:52:52.136014 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.135947 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/899381cf-6344-4939-84c2-61c7460098bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:52:52.136014 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.135949 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-kube-api-access-kx9bj" (OuterVolumeSpecName: "kube-api-access-kx9bj") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "kube-api-access-kx9bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:52:52.136127 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.136044 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "899381cf-6344-4939-84c2-61c7460098bf" (UID: "899381cf-6344-4939-84c2-61c7460098bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:52:52.234503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234477 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899381cf-6344-4939-84c2-61c7460098bf-istiod-ca-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234503 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234500 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234509 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-workload-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234519 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899381cf-6344-4939-84c2-61c7460098bf-istio-podinfo\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234527 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-data\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234535 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-istio-envoy\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234543 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899381cf-6344-4939-84c2-61c7460098bf-credential-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234551 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.234692 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.234560 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx9bj\" (UniqueName: \"kubernetes.io/projected/899381cf-6344-4939-84c2-61c7460098bf-kube-api-access-kx9bj\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:52:52.321954 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.321917 2575 generic.go:356] "Generic (PLEG): container finished" podID="899381cf-6344-4939-84c2-61c7460098bf" containerID="f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b" exitCode=0 Jul 20 16:52:52.322117 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.321987 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" Jul 20 16:52:52.322117 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.322000 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" event={"ID":"899381cf-6344-4939-84c2-61c7460098bf","Type":"ContainerDied","Data":"f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b"} Jul 20 16:52:52.322117 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.322095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6" event={"ID":"899381cf-6344-4939-84c2-61c7460098bf","Type":"ContainerDied","Data":"716fae9946ac5ba8cedbfb2d0c2335dc4cbbf5291ad239ecad596231b82f6112"} Jul 20 16:52:52.322289 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.322127 2575 scope.go:117] "RemoveContainer" containerID="f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b" Jul 20 16:52:52.331826 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.331809 2575 scope.go:117] "RemoveContainer" containerID="73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9" Jul 20 16:52:52.339847 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.339829 2575 scope.go:117] "RemoveContainer" containerID="f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b" Jul 20 16:52:52.340054 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:52:52.340037 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b\": container with ID starting with f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b not found: ID does not exist" containerID="f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b" Jul 20 16:52:52.340099 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.340060 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b"} err="failed to get container status \"f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b\": rpc error: code = NotFound desc = could not find container \"f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b\": container with ID starting with f81671d93bf5652f75a44faf512b06e3a8754f4cb1b3fe83120218d581adb91b not found: ID does not exist" Jul 20 16:52:52.340099 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.340075 2575 scope.go:117] "RemoveContainer" containerID="73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9" Jul 20 16:52:52.340301 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:52:52.340282 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9\": container with ID starting with 73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9 not found: ID does not exist" containerID="73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9" Jul 20 16:52:52.340351 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.340304 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9"} err="failed to get container status \"73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9\": rpc error: code = NotFound desc = could not find container \"73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9\": container with ID starting with 73247c8f829c07c49b44b1e14d37b307d25de1fba11113589acab5f0ebafc3d9 not found: ID does not exist" Jul 20 16:52:52.344495 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.344474 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6"] Jul 20 16:52:52.348095 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:52.348075 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9f2d87-openshift-default-847cf58677-x59d6"] Jul 20 16:52:53.602208 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:53.602178 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899381cf-6344-4939-84c2-61c7460098bf" path="/var/lib/kubelet/pods/899381cf-6344-4939-84c2-61c7460098bf/volumes" Jul 20 16:52:55.343414 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.343384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:55.671903 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.671822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:55.938743 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.938614 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8"] Jul 20 16:52:55.939251 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.939233 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" Jul 20 16:52:55.939315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.939254 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" Jul 20 16:52:55.939315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.939276 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" Jul 20 16:52:55.939315 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.939284 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" Jul 20 16:52:55.939461 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.939409 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" Jul 20 16:52:55.939461 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.939421 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="899381cf-6344-4939-84c2-61c7460098bf" containerName="istio-proxy" Jul 20 16:52:55.944159 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.944139 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.947028 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.947005 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c5c3fb-openshift-default-dockercfg-hmj6m\"" Jul 20 16:52:55.959104 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.959080 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8"] Jul 20 16:52:55.967807 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.967784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt5f7\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-kube-api-access-zt5f7\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.967911 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.967819 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b929ac6-934b-448d-bca1-30231dc13ada-istiod-ca-cert\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.967956 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.967928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b929ac6-934b-448d-bca1-30231dc13ada-istio-podinfo\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.968000 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.967973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-certs\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.968051 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.968034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-envoy\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.968094 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.968085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-data\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.968140 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.968111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-socket\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.968179 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.968160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-credential-socket\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.968229 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.968210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-istio-token\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:55.978777 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:55.978753 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:56.069137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-envoy\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069137 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-data\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-socket\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-credential-socket\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-istio-token\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5f7\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-kube-api-access-zt5f7\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b929ac6-934b-448d-bca1-30231dc13ada-istiod-ca-cert\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b929ac6-934b-448d-bca1-30231dc13ada-istio-podinfo\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069378 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-certs\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069788 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069533 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-data\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069788 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-socket\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.069788 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-certs\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.070012 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.069993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-credential-socket\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.070196 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.070159 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b929ac6-934b-448d-bca1-30231dc13ada-istiod-ca-cert\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.071796 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.071777 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-envoy\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.071903 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.071883 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b929ac6-934b-448d-bca1-30231dc13ada-istio-podinfo\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.077754 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.077735 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-istio-token\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.077947 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.077927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt5f7\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-kube-api-access-zt5f7\") pod \"e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.254599 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.254506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:56.324073 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.324032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:56.416928 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.416905 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8"] Jul 20 16:52:56.418370 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:52:56.418346 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b929ac6_934b_448d_bca1_30231dc13ada.slice/crio-0b287064b2c99c3769f01b3c9e456f6c669ecfce943af2d4a13c466457c3ac77 WatchSource:0}: Error finding container 0b287064b2c99c3769f01b3c9e456f6c669ecfce943af2d4a13c466457c3ac77: Status 404 returned error can't find the container with id 0b287064b2c99c3769f01b3c9e456f6c669ecfce943af2d4a13c466457c3ac77 Jul 20 16:52:56.420564 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.420532 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:52:56.420660 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.420594 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:52:56.420660 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:56.420641 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:52:57.350890 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:57.350855 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" event={"ID":"7b929ac6-934b-448d-bca1-30231dc13ada","Type":"ContainerStarted","Data":"dd2222fbac0ddf556ca33d87b80d2d2db7ce720db7155780ae0c579418906569"} Jul 20 16:52:57.351100 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:57.350917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" event={"ID":"7b929ac6-934b-448d-bca1-30231dc13ada","Type":"ContainerStarted","Data":"0b287064b2c99c3769f01b3c9e456f6c669ecfce943af2d4a13c466457c3ac77"} Jul 20 16:52:57.372134 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:57.372087 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podStartSLOduration=2.372073417 podStartE2EDuration="2.372073417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:52:57.370284143 +0000 UTC m=+2354.527101457" watchObservedRunningTime="2026-07-20 16:52:57.372073417 +0000 UTC m=+2354.528890704" Jul 20 16:52:58.255176 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:58.255142 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:58.260032 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:58.260005 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:58.356242 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:58.356211 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:58.357118 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:58.357096 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:52:59.340839 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:59.340807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:59.442930 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:59.442904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:59.548079 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:59.548032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:52:59.857411 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:52:59.857374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:00.071937 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:00.071906 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:00.168639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:00.168543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:03.778094 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:03.778062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:09.451386 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:09.451344 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:12.430760 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:12.430714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:12.527483 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:12.527439 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:13.993046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:13.992151 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:44814->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 20 16:53:13.993046 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:13.992222 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:44814->10.132.0.57:15021: read: connection reset by peer" Jul 20 16:53:14.437812 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:14.437776 2575 generic.go:356] "Generic (PLEG): container finished" podID="7b929ac6-934b-448d-bca1-30231dc13ada" containerID="dd2222fbac0ddf556ca33d87b80d2d2db7ce720db7155780ae0c579418906569" exitCode=0 Jul 20 16:53:14.437978 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:14.437845 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" event={"ID":"7b929ac6-934b-448d-bca1-30231dc13ada","Type":"ContainerDied","Data":"dd2222fbac0ddf556ca33d87b80d2d2db7ce720db7155780ae0c579418906569"} Jul 20 16:53:14.438290 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:14.438276 2575 scope.go:117] "RemoveContainer" containerID="dd2222fbac0ddf556ca33d87b80d2d2db7ce720db7155780ae0c579418906569" Jul 20 16:53:14.439362 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:14.439332 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:53:14.439427 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:14.439414 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:53:14.439471 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:14.439458 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 20 16:53:15.444408 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:15.444375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" event={"ID":"7b929ac6-934b-448d-bca1-30231dc13ada","Type":"ContainerStarted","Data":"35d41eb9657777d27c4dfdcc7e139564371691b81222508735a1e278dfc480f3"} Jul 20 16:53:15.644024 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:15.643993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:16.255264 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:16.255231 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:53:16.255656 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:16.255555 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:53:16.255905 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:16.255881 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:53:17.255747 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:17.255291 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:53:17.255747 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:17.255353 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:53:18.255732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:18.255679 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:53:18.255944 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:18.255757 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:53:19.255481 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:19.255443 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:53:19.255714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:19.255510 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:53:20.258920 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:20.258885 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:53:20.259504 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:20.259478 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:53:20.260608 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:20.260587 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 16:53:20.896171 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:20.896143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:20.997106 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:20.997082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:35.034053 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:35.034015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:39.512700 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:39.512669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:40.216669 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:40.216603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:40.316666 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:40.316604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:53:43.496698 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:43.496673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:53:43.501732 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:43.501711 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:53:43.530784 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:43.530761 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:53:43.535609 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:43.535588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:53:49.856215 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:53:49.856182 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:55:54.543093 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:55:54.543009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:55:55.418983 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:55:55.418953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:56:08.837943 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:56:08.837908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:56:09.489288 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:56:09.489250 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:56:33.052934 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:56:33.052898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:57:30.554532 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:57:30.554502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:57:32.911036 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:57:32.911001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:57:39.722086 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:57:39.722052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:06.704177 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:06.704142 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:06.805002 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:06.804966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:08.042534 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:08.042502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:13.362794 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:13.362759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:13.464404 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:13.464370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:21.706417 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:21.706376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:21.805295 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:21.805269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:41.053696 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:41.053610 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:41.149821 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:41.149790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:43.526338 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:43.526308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:58:43.531147 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:43.531120 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:58:43.562203 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:43.562183 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 16:58:43.567362 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:43.567345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tpr8l_5f3deb31-b87c-45e6-b2df-96cfc25514c1/ovn-acl-logging/0.log" Jul 20 16:58:52.170358 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:52.170326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:53.047068 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:53.047030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:58:53.967375 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:53.967340 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-140034189043504"] Jul 20 16:58:53.970833 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:53.970814 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:53.974519 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:53.974497 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ktqkz\"" Jul 20 16:58:53.982158 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:53.982132 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189043504"] Jul 20 16:58:54.016799 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:54.016756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjl5\" (UniqueName: \"kubernetes.io/projected/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3-kube-api-access-bbjl5\") pod \"test-curl-7456-140034189043504\" (UID: \"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3\") " pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:54.117875 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:54.117847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjl5\" (UniqueName: \"kubernetes.io/projected/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3-kube-api-access-bbjl5\") pod \"test-curl-7456-140034189043504\" (UID: \"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3\") " pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:54.130185 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:54.130156 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjl5\" (UniqueName: \"kubernetes.io/projected/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3-kube-api-access-bbjl5\") pod \"test-curl-7456-140034189043504\" (UID: \"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3\") " pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:54.280523 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:54.280498 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:54.421244 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:54.421219 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189043504"] Jul 20 16:58:54.423276 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:58:54.423232 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3e7ad0a_3a25_4f3d_95a8_82c1be1b05c3.slice/crio-db58c3c0a317ba8bedad369548f0754bfc3feea9f600e23307a958ba3ace7eb3 WatchSource:0}: Error finding container db58c3c0a317ba8bedad369548f0754bfc3feea9f600e23307a958ba3ace7eb3: Status 404 returned error can't find the container with id db58c3c0a317ba8bedad369548f0754bfc3feea9f600e23307a958ba3ace7eb3 Jul 20 16:58:54.424505 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:54.424486 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:58:55.175825 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:55.175799 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189043504" event={"ID":"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3","Type":"ContainerStarted","Data":"0137556de6c756d66d1d6c8676295c8c3b52e77f6c61b9dcb4f7730f7116a7bc"} Jul 20 16:58:55.176109 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:55.175838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189043504" event={"ID":"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3","Type":"ContainerStarted","Data":"db58c3c0a317ba8bedad369548f0754bfc3feea9f600e23307a958ba3ace7eb3"} Jul 20 16:58:55.316303 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:55.316282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-140034189043504_e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3/test-curl-7456-140034189043504/0.log" Jul 20 16:58:56.181771 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:56.181740 2575 generic.go:356] "Generic (PLEG): container finished" podID="e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3" containerID="0137556de6c756d66d1d6c8676295c8c3b52e77f6c61b9dcb4f7730f7116a7bc" exitCode=0 Jul 20 16:58:56.182134 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:56.181824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189043504" event={"ID":"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3","Type":"ContainerDied","Data":"0137556de6c756d66d1d6c8676295c8c3b52e77f6c61b9dcb4f7730f7116a7bc"} Jul 20 16:58:57.327261 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.327238 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:57.361626 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.361599 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-140034189043504"] Jul 20 16:58:57.366599 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.366577 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-140034189043504"] Jul 20 16:58:57.444796 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.444738 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbjl5\" (UniqueName: \"kubernetes.io/projected/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3-kube-api-access-bbjl5\") pod \"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3\" (UID: \"e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3\") " Jul 20 16:58:57.446746 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.446724 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3-kube-api-access-bbjl5" (OuterVolumeSpecName: "kube-api-access-bbjl5") pod "e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3" (UID: "e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3"). InnerVolumeSpecName "kube-api-access-bbjl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:58:57.545823 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.545780 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbjl5\" (UniqueName: \"kubernetes.io/projected/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3-kube-api-access-bbjl5\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:58:57.601989 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:57.601964 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3" path="/var/lib/kubelet/pods/e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3/volumes" Jul 20 16:58:58.193939 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:58.193907 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189043504" Jul 20 16:58:58.194125 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:58:58.193954 2575 scope.go:117] "RemoveContainer" containerID="0137556de6c756d66d1d6c8676295c8c3b52e77f6c61b9dcb4f7730f7116a7bc" Jul 20 16:59:00.404613 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.404576 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:00.405212 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.405191 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3" containerName="test-curl-7456-140034189043504" Jul 20 16:59:00.405302 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.405214 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3" containerName="test-curl-7456-140034189043504" Jul 20 16:59:00.405375 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.405362 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3e7ad0a-3a25-4f3d-95a8-82c1be1b05c3" containerName="test-curl-7456-140034189043504" Jul 20 16:59:00.409752 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.409729 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:00.412575 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.412550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ktqkz\"" Jul 20 16:59:00.416932 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.416913 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:00.470992 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.470967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9b9\" (UniqueName: \"kubernetes.io/projected/8cf05700-8e75-44c0-8665-7ed0db381c9f-kube-api-access-pt9b9\") pod \"test-curl-7456-140034189194416\" (UID: \"8cf05700-8e75-44c0-8665-7ed0db381c9f\") " pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:00.572083 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.572060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9b9\" (UniqueName: \"kubernetes.io/projected/8cf05700-8e75-44c0-8665-7ed0db381c9f-kube-api-access-pt9b9\") pod \"test-curl-7456-140034189194416\" (UID: \"8cf05700-8e75-44c0-8665-7ed0db381c9f\") " pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:00.580363 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.580341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9b9\" (UniqueName: \"kubernetes.io/projected/8cf05700-8e75-44c0-8665-7ed0db381c9f-kube-api-access-pt9b9\") pod \"test-curl-7456-140034189194416\" (UID: \"8cf05700-8e75-44c0-8665-7ed0db381c9f\") " pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:00.720214 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.720153 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:00.854066 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:00.854035 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:00.855783 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:59:00.855759 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cf05700_8e75_44c0_8665_7ed0db381c9f.slice/crio-9a466965f6c8dfcc3966713db53dafb771339bee2b3ea20e3ee4a3104cb73162 WatchSource:0}: Error finding container 9a466965f6c8dfcc3966713db53dafb771339bee2b3ea20e3ee4a3104cb73162: Status 404 returned error can't find the container with id 9a466965f6c8dfcc3966713db53dafb771339bee2b3ea20e3ee4a3104cb73162 Jul 20 16:59:01.217686 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:01.217657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189194416" event={"ID":"8cf05700-8e75-44c0-8665-7ed0db381c9f","Type":"ContainerStarted","Data":"f890bb6c6dc252f9b8df3ef57da7dbcf17c39c62b1400dff3ca62b49e3abdc34"} Jul 20 16:59:01.217796 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:01.217701 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189194416" event={"ID":"8cf05700-8e75-44c0-8665-7ed0db381c9f","Type":"ContainerStarted","Data":"9a466965f6c8dfcc3966713db53dafb771339bee2b3ea20e3ee4a3104cb73162"} Jul 20 16:59:01.234645 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:01.234582 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7456-140034189194416" podStartSLOduration=0.956407754 podStartE2EDuration="1.234565177s" totalImagesPullingTime="278.157423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:59:01.231905332 +0000 UTC m=+2718.388722618" watchObservedRunningTime="2026-07-20 16:59:01.234565177 +0000 UTC m=+2718.391382462" Jul 20 16:59:01.237505 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:59:01.237486 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cf05700_8e75_44c0_8665_7ed0db381c9f.slice/crio-conmon-f890bb6c6dc252f9b8df3ef57da7dbcf17c39c62b1400dff3ca62b49e3abdc34.scope\": RecentStats: unable to find data in memory cache]" Jul 20 16:59:01.320439 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:01.320415 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-140034189194416_8cf05700-8e75-44c0-8665-7ed0db381c9f/test-curl-7456-140034189194416/0.log" Jul 20 16:59:02.223804 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:02.223764 2575 generic.go:356] "Generic (PLEG): container finished" podID="8cf05700-8e75-44c0-8665-7ed0db381c9f" containerID="f890bb6c6dc252f9b8df3ef57da7dbcf17c39c62b1400dff3ca62b49e3abdc34" exitCode=0 Jul 20 16:59:02.224208 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:02.223855 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189194416" event={"ID":"8cf05700-8e75-44c0-8665-7ed0db381c9f","Type":"ContainerDied","Data":"f890bb6c6dc252f9b8df3ef57da7dbcf17c39c62b1400dff3ca62b49e3abdc34"} Jul 20 16:59:03.366575 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.366550 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:03.394464 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.394441 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9b9\" (UniqueName: \"kubernetes.io/projected/8cf05700-8e75-44c0-8665-7ed0db381c9f-kube-api-access-pt9b9\") pod \"8cf05700-8e75-44c0-8665-7ed0db381c9f\" (UID: \"8cf05700-8e75-44c0-8665-7ed0db381c9f\") " Jul 20 16:59:03.397918 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.397881 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf05700-8e75-44c0-8665-7ed0db381c9f-kube-api-access-pt9b9" (OuterVolumeSpecName: "kube-api-access-pt9b9") pod "8cf05700-8e75-44c0-8665-7ed0db381c9f" (UID: "8cf05700-8e75-44c0-8665-7ed0db381c9f"). InnerVolumeSpecName "kube-api-access-pt9b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:59:03.400987 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.400965 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:03.403173 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.403150 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:03.495425 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.495361 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9b9\" (UniqueName: \"kubernetes.io/projected/8cf05700-8e75-44c0-8665-7ed0db381c9f-kube-api-access-pt9b9\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:59:03.511154 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.511132 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:03.511524 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.511511 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf05700-8e75-44c0-8665-7ed0db381c9f" containerName="test-curl-7456-140034189194416" Jul 20 16:59:03.511577 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.511525 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf05700-8e75-44c0-8665-7ed0db381c9f" containerName="test-curl-7456-140034189194416" Jul 20 16:59:03.511612 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.511599 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf05700-8e75-44c0-8665-7ed0db381c9f" containerName="test-curl-7456-140034189194416" Jul 20 16:59:03.514584 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.514569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:03.518481 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.518460 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:03.596195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.596166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpxxp\" (UniqueName: \"kubernetes.io/projected/c3308c51-e202-4b6e-a20b-bcc7c9a28b65-kube-api-access-mpxxp\") pod \"test-curl-7456-140034189194416\" (UID: \"c3308c51-e202-4b6e-a20b-bcc7c9a28b65\") " pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:03.602206 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.602182 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf05700-8e75-44c0-8665-7ed0db381c9f" path="/var/lib/kubelet/pods/8cf05700-8e75-44c0-8665-7ed0db381c9f/volumes" Jul 20 16:59:03.697555 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.697529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpxxp\" (UniqueName: \"kubernetes.io/projected/c3308c51-e202-4b6e-a20b-bcc7c9a28b65-kube-api-access-mpxxp\") pod \"test-curl-7456-140034189194416\" (UID: \"c3308c51-e202-4b6e-a20b-bcc7c9a28b65\") " pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:03.706343 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.706319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpxxp\" (UniqueName: \"kubernetes.io/projected/c3308c51-e202-4b6e-a20b-bcc7c9a28b65-kube-api-access-mpxxp\") pod \"test-curl-7456-140034189194416\" (UID: \"c3308c51-e202-4b6e-a20b-bcc7c9a28b65\") " pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:03.830847 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.830820 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:03.963828 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:03.963805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:03.966225 ip-10-0-137-195 kubenswrapper[2575]: W0720 16:59:03.966198 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3308c51_e202_4b6e_a20b_bcc7c9a28b65.slice/crio-e66ff1f28aeca8c31c5dfec2d1a0fdaa36aada2d52b58d5b708767ac9b136604 WatchSource:0}: Error finding container e66ff1f28aeca8c31c5dfec2d1a0fdaa36aada2d52b58d5b708767ac9b136604: Status 404 returned error can't find the container with id e66ff1f28aeca8c31c5dfec2d1a0fdaa36aada2d52b58d5b708767ac9b136604 Jul 20 16:59:04.235249 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:04.235225 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:04.235364 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:04.235251 2575 scope.go:117] "RemoveContainer" containerID="f890bb6c6dc252f9b8df3ef57da7dbcf17c39c62b1400dff3ca62b49e3abdc34" Jul 20 16:59:04.236639 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:04.236603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189194416" event={"ID":"c3308c51-e202-4b6e-a20b-bcc7c9a28b65","Type":"ContainerStarted","Data":"e66ff1f28aeca8c31c5dfec2d1a0fdaa36aada2d52b58d5b708767ac9b136604"} Jul 20 16:59:05.248195 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:05.248157 2575 generic.go:356] "Generic (PLEG): container finished" podID="c3308c51-e202-4b6e-a20b-bcc7c9a28b65" containerID="2ca70aa7cd4598da500b542b514aec476a3ea30c108bd86db5b4e7cab884b928" exitCode=0 Jul 20 16:59:05.248576 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:05.248250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7456-140034189194416" event={"ID":"c3308c51-e202-4b6e-a20b-bcc7c9a28b65","Type":"ContainerDied","Data":"2ca70aa7cd4598da500b542b514aec476a3ea30c108bd86db5b4e7cab884b928"} Jul 20 16:59:06.398376 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.398355 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:06.420460 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.420432 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7456-140034189194416_c3308c51-e202-4b6e-a20b-bcc7c9a28b65/test-curl-7456-140034189194416/0.log" Jul 20 16:59:06.444274 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.444247 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:06.447805 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.447781 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7456-140034189194416"] Jul 20 16:59:06.521450 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.521431 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpxxp\" (UniqueName: \"kubernetes.io/projected/c3308c51-e202-4b6e-a20b-bcc7c9a28b65-kube-api-access-mpxxp\") pod \"c3308c51-e202-4b6e-a20b-bcc7c9a28b65\" (UID: \"c3308c51-e202-4b6e-a20b-bcc7c9a28b65\") " Jul 20 16:59:06.523429 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.523406 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3308c51-e202-4b6e-a20b-bcc7c9a28b65-kube-api-access-mpxxp" (OuterVolumeSpecName: "kube-api-access-mpxxp") pod "c3308c51-e202-4b6e-a20b-bcc7c9a28b65" (UID: "c3308c51-e202-4b6e-a20b-bcc7c9a28b65"). InnerVolumeSpecName "kube-api-access-mpxxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:59:06.622798 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:06.622766 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpxxp\" (UniqueName: \"kubernetes.io/projected/c3308c51-e202-4b6e-a20b-bcc7c9a28b65-kube-api-access-mpxxp\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 16:59:07.261935 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:07.261904 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e66ff1f28aeca8c31c5dfec2d1a0fdaa36aada2d52b58d5b708767ac9b136604" Jul 20 16:59:07.261935 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:07.261916 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:07.271910 ip-10-0-137-195 kubenswrapper[2575]: E0720 16:59:07.271873 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7456-140034189194416\" is forbidden: User \"system:node:ip-10-0-137-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-195.ec2.internal' and this object" podUID="c3308c51-e202-4b6e-a20b-bcc7c9a28b65" pod="opendatahub/test-curl-7456-140034189194416" Jul 20 16:59:07.603124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:07.603043 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3308c51-e202-4b6e-a20b-bcc7c9a28b65" path="/var/lib/kubelet/pods/c3308c51-e202-4b6e-a20b-bcc7c9a28b65/volumes" Jul 20 16:59:13.213139 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:13.213046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:13.311214 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:13.311183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:22.979265 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:22.979211 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:27.563463 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:27.563418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:27.964909 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:27.964792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:33.972968 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:33.972927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:34.073317 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:34.073279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:34.254124 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:34.254040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:34.478815 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:34.478770 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:35.148927 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:35.148885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:35.248875 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:35.248847 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:45.324738 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:45.324699 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:49.685926 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:49.685893 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:50.076800 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:50.076776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:56.096796 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:56.096752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:56.160714 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:56.160680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:56.319674 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:56.319643 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8"] Jul 20 16:59:56.319900 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:56.319873 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" containerID="cri-o://35d41eb9657777d27c4dfdcc7e139564371691b81222508735a1e278dfc480f3" gracePeriod=30 Jul 20 16:59:56.349963 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:56.349879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 16:59:56.571816 ip-10-0-137-195 kubenswrapper[2575]: I0720 16:59:56.571782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 17:00:01.539596 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.539564 2575 generic.go:356] "Generic (PLEG): container finished" podID="7b929ac6-934b-448d-bca1-30231dc13ada" containerID="35d41eb9657777d27c4dfdcc7e139564371691b81222508735a1e278dfc480f3" exitCode=0 Jul 20 17:00:01.540114 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.539610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" event={"ID":"7b929ac6-934b-448d-bca1-30231dc13ada","Type":"ContainerDied","Data":"35d41eb9657777d27c4dfdcc7e139564371691b81222508735a1e278dfc480f3"} Jul 20 17:00:01.540114 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.539678 2575 scope.go:117] "RemoveContainer" containerID="dd2222fbac0ddf556ca33d87b80d2d2db7ce720db7155780ae0c579418906569" Jul 20 17:00:01.581217 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.581158 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 17:00:01.764550 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764513 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-socket\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.764767 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764560 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt5f7\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-kube-api-access-zt5f7\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.764767 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764589 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-istio-token\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.764767 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764605 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-envoy\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.764767 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764651 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-certs\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.764767 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764720 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b929ac6-934b-448d-bca1-30231dc13ada-istio-podinfo\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.764767 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764751 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b929ac6-934b-448d-bca1-30231dc13ada-istiod-ca-cert\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.765157 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764858 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:00:01.765157 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764931 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-data\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.765157 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.764957 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-credential-socket\") pod \"7b929ac6-934b-448d-bca1-30231dc13ada\" (UID: \"7b929ac6-934b-448d-bca1-30231dc13ada\") " Jul 20 17:00:01.765316 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.765136 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:00:01.765316 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.765246 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b929ac6-934b-448d-bca1-30231dc13ada-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 17:00:01.765425 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.765317 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.765425 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.765334 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-workload-certs\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.765425 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.765365 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:00:01.765820 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.765799 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:00:01.767015 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.766993 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b929ac6-934b-448d-bca1-30231dc13ada-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 17:00:01.767182 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.767160 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 17:00:01.767377 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.767358 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:00:01.767439 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.767425 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-kube-api-access-zt5f7" (OuterVolumeSpecName: "kube-api-access-zt5f7") pod "7b929ac6-934b-448d-bca1-30231dc13ada" (UID: "7b929ac6-934b-448d-bca1-30231dc13ada"). InnerVolumeSpecName "kube-api-access-zt5f7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866460 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-istio-token\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866480 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-envoy\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866490 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b929ac6-934b-448d-bca1-30231dc13ada-istio-podinfo\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866499 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b929ac6-934b-448d-bca1-30231dc13ada-istiod-ca-cert\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866507 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-istio-data\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866515 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b929ac6-934b-448d-bca1-30231dc13ada-credential-socket\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:01.866520 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:01.866523 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt5f7\" (UniqueName: \"kubernetes.io/projected/7b929ac6-934b-448d-bca1-30231dc13ada-kube-api-access-zt5f7\") on node \"ip-10-0-137-195.ec2.internal\" DevicePath \"\"" Jul 20 17:00:02.146430 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.146346 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pd46p_99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0/manager/0.log" Jul 20 17:00:02.262074 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.262047 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-crd2w_736da8cc-e301-4dfe-a834-67694c9e831a/manager/0.log" Jul 20 17:00:02.483178 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.483098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sp6tb_21d4efeb-b47e-43fd-9ede-c7194b00f91b/server/0.log" Jul 20 17:00:02.550466 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.550432 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" event={"ID":"7b929ac6-934b-448d-bca1-30231dc13ada","Type":"ContainerDied","Data":"0b287064b2c99c3769f01b3c9e456f6c669ecfce943af2d4a13c466457c3ac77"} Jul 20 17:00:02.550466 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.550457 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8" Jul 20 17:00:02.550967 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.550503 2575 scope.go:117] "RemoveContainer" containerID="35d41eb9657777d27c4dfdcc7e139564371691b81222508735a1e278dfc480f3" Jul 20 17:00:02.576717 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.576690 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8"] Jul 20 17:00:02.580113 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.580094 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c5c3fb-openshift-default-75bdf6d98c-g4wj8"] Jul 20 17:00:02.595134 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.595113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cj7ch_163a41e5-766b-4137-b6d5-07229d0df573/manager/0.log" Jul 20 17:00:02.948383 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.948360 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-gs5bt_fbea8199-0b57-4247-b627-de32810c2753/copy-manifests/0.log" Jul 20 17:00:02.954803 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:02.954786 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-gs5bt_fbea8199-0b57-4247-b627-de32810c2753/manager/0.log" Jul 20 17:00:03.290646 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:03.290606 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-855c688b74-2r448_fdb25f3a-a633-47eb-a1a5-024460ccc5f4/maas-api/0.log" Jul 20 17:00:03.403258 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:03.403238 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742750-8tcln_af50b65f-eac3-4e17-8200-742c8fa5a830/cleanup/0.log" Jul 20 17:00:03.602036 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:03.601967 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" path="/var/lib/kubelet/pods/7b929ac6-934b-448d-bca1-30231dc13ada/volumes" Jul 20 17:00:03.751318 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:03.751294 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-pt84g_57628af6-6317-44a8-bed1-77b0f013844c/postgres/0.log" Jul 20 17:00:05.132491 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:05.132466 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n8vlf_bb4cc956-9371-4427-87a1-dff44b8836d1/manager/0.log" Jul 20 17:00:05.239839 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:05.239814 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zc67q_96ef6888-57ad-4078-b57c-aaa865053b84/manager/0.log" Jul 20 17:00:05.467649 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:05.467545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kglvl_b480e33b-e5ac-4599-ad51-37a7f250b1e2/registry-server/0.log" Jul 20 17:00:05.808960 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:05.808930 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pxph2_cc1f0aab-36aa-4f1f-a028-008136cd1cd0/manager/0.log" Jul 20 17:00:06.500031 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:06.500001 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4f98b7bc-bmbcs_bd9741b9-0a1b-4beb-a201-48d81e62cee4/kube-auth-proxy/0.log" Jul 20 17:00:06.613131 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:06.613108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/1.log" Jul 20 17:00:06.731258 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:06.731234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bg7qc_bd6c1d7d-68d1-44bd-8f27-562088ce9397/payload-pre-processing/0.log" Jul 20 17:00:06.967324 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:06.967299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5689bf4d-xfpk9_8d9a4a99-1e0d-4fe4-b9b1-518a0372186d/router/0.log" Jul 20 17:00:07.312635 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:07.312598 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nbzx4_31284ea8-02bb-4b5d-8aff-20a2d07617a1/main/0.log" Jul 20 17:00:07.427489 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:07.427467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9njwv_681501bd-1cd0-45a1-9a77-d0d321ea023d/main/0.log" Jul 20 17:00:07.753425 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:07.753356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-kmnxg_a9cb1668-9b39-49e7-8f94-d84228b6cb85/main/0.log" Jul 20 17:00:13.621598 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:13.621569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 17:00:13.783902 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:13.783871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" limit=1024 Jul 20 17:00:16.407437 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:16.407403 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pbdpb_5fe7631c-9399-4c7b-a8c2-c7ea1cfc8b7e/global-pull-secret-syncer/0.log" Jul 20 17:00:16.501376 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:16.501351 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4tcvx_36ac1415-8810-4f4b-988e-020515265b2c/konnectivity-agent/0.log" Jul 20 17:00:16.648595 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:16.648571 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-195.ec2.internal_a729a32735cfab01117e99e7a9c46943/haproxy/0.log" Jul 20 17:00:21.628972 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:21.628945 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n8vlf_bb4cc956-9371-4427-87a1-dff44b8836d1/manager/0.log" Jul 20 17:00:21.655082 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:21.655058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zc67q_96ef6888-57ad-4078-b57c-aaa865053b84/manager/0.log" Jul 20 17:00:21.725229 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:21.725208 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kglvl_b480e33b-e5ac-4599-ad51-37a7f250b1e2/registry-server/0.log" Jul 20 17:00:21.992739 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:21.992666 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pxph2_cc1f0aab-36aa-4f1f-a028-008136cd1cd0/manager/0.log" Jul 20 17:00:23.986919 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:23.986852 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-qnskx_d11d1dbb-8796-45d2-a8e5-c4063501cd04/cluster-monitoring-operator/0.log" Jul 20 17:00:24.266290 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:24.266263 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pgdsk_0e5101a7-7169-4319-a72c-7896181be49d/node-exporter/0.log" Jul 20 17:00:24.288701 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:24.288679 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pgdsk_0e5101a7-7169-4319-a72c-7896181be49d/kube-rbac-proxy/0.log" Jul 20 17:00:24.311486 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:24.311466 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pgdsk_0e5101a7-7169-4319-a72c-7896181be49d/init-textfile/0.log" Jul 20 17:00:26.143893 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.143858 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-jfddt_d8d6a407-ff59-40fd-8663-058831636b28/networking-console-plugin/0.log" Jul 20 17:00:26.296544 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.296513 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5"] Jul 20 17:00:26.296946 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.296931 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" Jul 20 17:00:26.296996 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.296948 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" Jul 20 17:00:26.296996 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.296971 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" Jul 20 17:00:26.296996 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.296977 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" Jul 20 17:00:26.297120 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.296986 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3308c51-e202-4b6e-a20b-bcc7c9a28b65" containerName="test-curl-7456-140034189194416" Jul 20 17:00:26.297120 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.297042 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3308c51-e202-4b6e-a20b-bcc7c9a28b65" containerName="test-curl-7456-140034189194416" Jul 20 17:00:26.297120 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.297121 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" Jul 20 17:00:26.297272 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.297129 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b929ac6-934b-448d-bca1-30231dc13ada" containerName="istio-proxy" Jul 20 17:00:26.297272 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.297136 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3308c51-e202-4b6e-a20b-bcc7c9a28b65" containerName="test-curl-7456-140034189194416" Jul 20 17:00:26.300438 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.300421 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.303252 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.303233 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xq7b\"/\"kube-root-ca.crt\"" Jul 20 17:00:26.304406 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.304387 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6xq7b\"/\"openshift-service-ca.crt\"" Jul 20 17:00:26.304478 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.304428 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6xq7b\"/\"default-dockercfg-gflxw\"" Jul 20 17:00:26.313372 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.313352 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5"] Jul 20 17:00:26.384418 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.384393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-lib-modules\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.384531 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.384436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-podres\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.384531 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.384508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-sys\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.384605 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.384549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-proc\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.384605 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.384579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68wb9\" (UniqueName: \"kubernetes.io/projected/7e12fa59-07e9-455a-b5fb-eb591c0c2453-kube-api-access-68wb9\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485186 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-sys\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485186 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-proc\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485341 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wb9\" (UniqueName: \"kubernetes.io/projected/7e12fa59-07e9-455a-b5fb-eb591c0c2453-kube-api-access-68wb9\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485341 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-sys\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485341 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-proc\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485341 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-lib-modules\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485495 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-podres\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485495 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485456 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-lib-modules\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.485495 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.485489 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e12fa59-07e9-455a-b5fb-eb591c0c2453-podres\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.495985 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.495967 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68wb9\" (UniqueName: \"kubernetes.io/projected/7e12fa59-07e9-455a-b5fb-eb591c0c2453-kube-api-access-68wb9\") pod \"perf-node-gather-daemonset-fg5f5\" (UID: \"7e12fa59-07e9-455a-b5fb-eb591c0c2453\") " pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.610291 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.610270 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:26.744481 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.744456 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5"] Jul 20 17:00:26.746247 ip-10-0-137-195 kubenswrapper[2575]: W0720 17:00:26.746222 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e12fa59_07e9_455a_b5fb_eb591c0c2453.slice/crio-9d5ba2e83530a6c05de341127314bc867f82ea5872bf844809892f0f3ba6e870 WatchSource:0}: Error finding container 9d5ba2e83530a6c05de341127314bc867f82ea5872bf844809892f0f3ba6e870: Status 404 returned error can't find the container with id 9d5ba2e83530a6c05de341127314bc867f82ea5872bf844809892f0f3ba6e870 Jul 20 17:00:26.809034 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.809015 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/1.log" Jul 20 17:00:26.814312 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:26.814272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-h9z4k_0d231d19-8c91-4909-a694-274ab60dc28b/console-operator/2.log" Jul 20 17:00:27.675672 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:27.675636 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" event={"ID":"7e12fa59-07e9-455a-b5fb-eb591c0c2453","Type":"ContainerStarted","Data":"302e34f125d4e87395366da6a7e9302d76d82a7eb94fbfe50b3c2ffc1dd16d5d"} Jul 20 17:00:27.676047 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:27.675685 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" event={"ID":"7e12fa59-07e9-455a-b5fb-eb591c0c2453","Type":"ContainerStarted","Data":"9d5ba2e83530a6c05de341127314bc867f82ea5872bf844809892f0f3ba6e870"} Jul 20 17:00:27.676047 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:27.675741 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:27.693542 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:27.693503 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" podStartSLOduration=1.693491436 podStartE2EDuration="1.693491436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:00:27.69282196 +0000 UTC m=+2804.849639249" watchObservedRunningTime="2026-07-20 17:00:27.693491436 +0000 UTC m=+2804.850308725" Jul 20 17:00:28.028804 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:28.028769 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-smx9m_7e6961fd-69bc-4e1c-9032-e87968ea6850/volume-data-source-validator/0.log" Jul 20 17:00:29.106149 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:29.106064 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xdvh_1051119f-7bbc-4c90-bf2c-e558d052aae7/dns/0.log" Jul 20 17:00:29.128922 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:29.128898 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xdvh_1051119f-7bbc-4c90-bf2c-e558d052aae7/kube-rbac-proxy/0.log" Jul 20 17:00:29.203019 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:29.202999 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hl66h_a4ee803d-c3da-442d-8041-6185d4b45655/dns-node-resolver/0.log" Jul 20 17:00:29.877490 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:29.877462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fcm8b_4060d656-a1cd-4f03-92e1-5592b99589d0/node-ca/0.log" Jul 20 17:00:31.152352 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:31.152321 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4f98b7bc-bmbcs_bd9741b9-0a1b-4beb-a201-48d81e62cee4/kube-auth-proxy/0.log" Jul 20 17:00:31.184075 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:31.184052 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/0.log" Jul 20 17:00:31.215397 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:31.215369 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/1.log" Jul 20 17:00:31.245745 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:31.245727 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bg7qc_bd6c1d7d-68d1-44bd-8f27-562088ce9397/payload-pre-processing/0.log" Jul 20 17:00:31.299298 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:31.299277 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5689bf4d-xfpk9_8d9a4a99-1e0d-4fe4-b9b1-518a0372186d/router/0.log" Jul 20 17:00:32.101933 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:32.101903 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xp4t9_af51abb7-967c-4c28-8d7f-bf7404e64c29/serve-healthcheck-canary/0.log" Jul 20 17:00:32.606095 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:32.606071 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5lnsb_c8d011e9-8d9b-4585-bad2-052fcbcd3412/insights-operator/0.log" Jul 20 17:00:32.606785 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:32.606771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5lnsb_c8d011e9-8d9b-4585-bad2-052fcbcd3412/insights-operator/1.log" Jul 20 17:00:32.629588 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:32.629568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kmgp_6e0bf1c6-7976-46f1-b26a-057b07e287b7/kube-rbac-proxy/0.log" Jul 20 17:00:32.654312 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:32.654293 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kmgp_6e0bf1c6-7976-46f1-b26a-057b07e287b7/exporter/0.log" Jul 20 17:00:32.678160 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:32.678139 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kmgp_6e0bf1c6-7976-46f1-b26a-057b07e287b7/extractor/0.log" Jul 20 17:00:33.691506 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:33.691482 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6xq7b/perf-node-gather-daemonset-fg5f5" Jul 20 17:00:35.026498 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:35.026474 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pd46p_99e2bd0c-c6fd-4bbd-8e4a-96d8043dfbd0/manager/0.log" Jul 20 17:00:35.204960 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:35.204932 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-crd2w_736da8cc-e301-4dfe-a834-67694c9e831a/manager/0.log" Jul 20 17:00:35.334321 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:35.334294 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sp6tb_21d4efeb-b47e-43fd-9ede-c7194b00f91b/server/0.log" Jul 20 17:00:35.407888 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:35.407871 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cj7ch_163a41e5-766b-4137-b6d5-07229d0df573/manager/0.log" Jul 20 17:00:35.596697 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:35.596672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-gs5bt_fbea8199-0b57-4247-b627-de32810c2753/manager/0.log" Jul 20 17:00:35.622566 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:35.622546 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bbb748554-gs5bt_fbea8199-0b57-4247-b627-de32810c2753/copy-manifests/0.log" Jul 20 17:00:36.876814 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:36.876789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4f98b7bc-bmbcs_bd9741b9-0a1b-4beb-a201-48d81e62cee4/kube-auth-proxy/0.log" Jul 20 17:00:36.898020 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:36.897987 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/0.log" Jul 20 17:00:36.924154 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:36.924128 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/1.log" Jul 20 17:00:36.943404 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:36.943381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bg7qc_bd6c1d7d-68d1-44bd-8f27-562088ce9397/payload-pre-processing/0.log" Jul 20 17:00:36.978162 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:36.978126 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5689bf4d-xfpk9_8d9a4a99-1e0d-4fe4-b9b1-518a0372186d/router/0.log" Jul 20 17:00:38.579492 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:38.579463 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4f98b7bc-bmbcs_bd9741b9-0a1b-4beb-a201-48d81e62cee4/kube-auth-proxy/0.log" Jul 20 17:00:38.598941 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:38.598923 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/0.log" Jul 20 17:00:38.622930 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:38.622899 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pn7kh_b5898d8b-68a2-4652-b24f-1e01a7d3f8b8/istio-proxy/1.log" Jul 20 17:00:38.645017 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:38.644996 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bg7qc_bd6c1d7d-68d1-44bd-8f27-562088ce9397/payload-pre-processing/0.log" Jul 20 17:00:38.678459 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:38.678436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5689bf4d-xfpk9_8d9a4a99-1e0d-4fe4-b9b1-518a0372186d/router/0.log" Jul 20 17:00:42.063069 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:42.063041 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-t4wsn_4473d8c9-9dcd-4729-8447-ab9c09fe6bfd/migrator/0.log" Jul 20 17:00:42.085368 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:42.085306 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-t4wsn_4473d8c9-9dcd-4729-8447-ab9c09fe6bfd/graceful-termination/0.log" Jul 20 17:00:42.431820 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:42.431748 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-574jz_ec4be2c5-4708-4c5f-aa26-93a0c4385983/kube-storage-version-migrator-operator/1.log" Jul 20 17:00:42.432582 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:42.432556 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-574jz_ec4be2c5-4708-4c5f-aa26-93a0c4385983/kube-storage-version-migrator-operator/0.log" Jul 20 17:00:43.603947 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:43.603920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g6mkn_2c22a50f-4bc8-49ad-b79a-b3801170e739/kube-multus-additional-cni-plugins/0.log" Jul 20 17:00:43.627466 ip-10-0-137-195 kubenswrapper[2575]: I0720 17:00:43.627442 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g6mkn_2c22a50f-4bc8-49ad-b79a-b3801170e739/egress-router-binary-copy/0.log"