Jul 22 13:46:13.247210 ip-10-0-140-215 systemd[1]: Starting Kubernetes Kubelet... Jul 22 13:46:13.600430 ip-10-0-140-215 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 13:46:13.600430 ip-10-0-140-215 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 13:46:13.600430 ip-10-0-140-215 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 13:46:13.600430 ip-10-0-140-215 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 13:46:13.600430 ip-10-0-140-215 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 13:46:13.601277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.601190 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607124 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607154 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607158 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607163 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607166 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607168 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607172 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607174 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607178 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607180 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 13:46:13.607162 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607183 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607186 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607189 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607191 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607194 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607197 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607199 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607202 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607204 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607207 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607210 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607213 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607215 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607218 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607220 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607223 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607225 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607228 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607231 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607233 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 13:46:13.607524 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607235 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607238 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607241 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607243 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607245 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607248 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607250 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607253 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607256 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607258 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607260 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607263 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607266 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607268 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607272 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607274 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607277 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607280 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607284 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 13:46:13.608009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607288 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607291 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607295 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607298 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607301 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607303 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607306 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607309 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607312 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607314 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607317 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607319 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607322 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607324 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607328 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607330 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607332 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607335 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607337 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607340 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 13:46:13.608460 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607342 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607345 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607347 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607350 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607352 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607355 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607357 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607361 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607364 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607367 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607369 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607372 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607375 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607378 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607382 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607386 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607389 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607392 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607395 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 13:46:13.608940 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607397 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607400 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607404 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607407 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607411 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607414 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607416 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607419 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607422 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607424 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.607427 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608772 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608781 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608784 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608787 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608790 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608793 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608796 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608798 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 13:46:13.609429 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608801 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608805 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608807 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608810 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608813 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608815 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608818 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608821 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608823 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608827 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608830 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608832 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608835 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608837 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608840 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608842 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608845 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608847 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608849 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608852 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608854 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 13:46:13.609892 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608857 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608859 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608862 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608868 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608872 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608875 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608878 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608880 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608883 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608886 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608888 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608892 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608896 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608899 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608902 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608919 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608922 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608925 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608928 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 13:46:13.610417 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608930 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608933 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608936 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608939 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608941 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608944 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608947 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608950 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608952 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608955 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608958 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608960 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608963 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608965 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608968 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608970 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608974 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608976 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608979 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 13:46:13.610885 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608981 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608984 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608987 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608989 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608992 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608994 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.608997 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609000 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609003 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609005 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609008 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609010 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609013 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609016 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609019 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609022 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609025 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609028 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609030 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609033 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 13:46:13.611352 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609035 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609038 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609040 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609043 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609045 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609047 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609050 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609052 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609056 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609060 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609062 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609065 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609443 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609449 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609452 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609455 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609458 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609461 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609464 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609466 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 13:46:13.611833 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609469 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609471 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609474 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609477 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609479 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609481 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609484 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609487 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609490 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609492 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609495 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609498 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609500 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609502 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609505 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609508 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609510 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609512 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609515 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609518 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 13:46:13.612332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609520 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609523 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609526 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609529 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609531 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609534 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609537 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609539 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609542 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609544 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609547 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609549 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609552 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609554 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609557 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609560 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609562 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609565 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609567 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 13:46:13.612812 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609570 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609572 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609575 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609578 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609580 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609583 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609586 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609588 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609591 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609594 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609596 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609599 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609601 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609603 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609606 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609608 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609611 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609614 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609616 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609618 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 13:46:13.613261 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609622 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609624 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609627 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609630 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609632 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609635 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609637 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609640 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609643 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609645 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609648 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609650 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609653 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609655 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609657 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609660 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609664 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609668 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609671 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 13:46:13.613735 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609674 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609677 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609679 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609683 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609685 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609689 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609692 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609694 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609697 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609699 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609702 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609705 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.609708 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609778 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609785 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609794 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609798 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609802 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609805 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609809 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 13:46:13.614233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609813 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609816 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609819 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609822 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609825 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609828 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609831 2556 flags.go:64] FLAG: --cgroup-root="" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609834 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609837 2556 flags.go:64] FLAG: --client-ca-file="" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609840 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609846 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609850 2556 flags.go:64] FLAG: --cluster-domain="" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609853 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609856 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609859 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609862 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609866 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609869 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609871 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609874 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609877 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609880 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609883 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609886 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 13:46:13.614778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609889 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609893 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609896 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609899 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609902 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609918 2556 flags.go:64] FLAG: --enable-server="true" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609921 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609926 2556 flags.go:64] FLAG: --event-burst="100" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609929 2556 flags.go:64] FLAG: --event-qps="50" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609932 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609935 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609938 2556 flags.go:64] FLAG: --eviction-hard="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609942 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609944 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609947 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609950 2556 flags.go:64] FLAG: --eviction-soft="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609953 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609956 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609961 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609964 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609967 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609970 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609972 2556 flags.go:64] FLAG: --feature-gates="" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609976 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609979 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 13:46:13.615360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609982 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609985 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609988 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609991 2556 flags.go:64] FLAG: --help="false" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609994 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.609997 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610000 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610003 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610006 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610009 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610013 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610015 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610018 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610021 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610024 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610027 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610030 2556 flags.go:64] FLAG: --kube-reserved="" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610032 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610035 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610038 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610041 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610043 2556 flags.go:64] FLAG: --lock-file="" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610046 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610049 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 13:46:13.615981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610052 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610058 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610062 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610065 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610068 2556 flags.go:64] FLAG: --logging-format="text" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610070 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610074 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610077 2556 flags.go:64] FLAG: --manifest-url="" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610080 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610084 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610087 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610091 2556 flags.go:64] FLAG: --max-pods="110" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610094 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610097 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610100 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610103 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610107 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610110 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610113 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610120 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610123 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610126 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610129 2556 flags.go:64] FLAG: --pod-cidr="" Jul 22 13:46:13.616566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610132 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610138 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610140 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610144 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610147 2556 flags.go:64] FLAG: --port="10250" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610150 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610153 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c949d3374280020" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610156 2556 flags.go:64] FLAG: --qos-reserved="" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610159 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610162 2556 flags.go:64] FLAG: --register-node="true" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610166 2556 flags.go:64] FLAG: --register-with-taints="" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610169 2556 flags.go:64] FLAG: --registry-burst="10" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610172 2556 flags.go:64] FLAG: --registry-qps="5" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610176 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610178 2556 flags.go:64] FLAG: --reserved-memory="" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610182 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610185 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610188 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610191 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610194 2556 flags.go:64] FLAG: --runonce="false" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610197 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610200 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610203 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610206 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610208 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610211 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 13:46:13.617148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610216 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610219 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610222 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610225 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610227 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610230 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610233 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610236 2556 flags.go:64] FLAG: --system-cgroups="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610239 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610244 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610247 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610249 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610253 2556 flags.go:64] FLAG: --tls-min-version="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610256 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610258 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610261 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610268 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610271 2556 flags.go:64] FLAG: --v="2" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610276 2556 flags.go:64] FLAG: --version="false" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610280 2556 flags.go:64] FLAG: --vmodule="" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610290 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.610294 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610405 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610409 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610412 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 13:46:13.617843 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610415 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610418 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610420 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610424 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610426 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610429 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610432 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610438 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610442 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610445 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610447 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610450 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610453 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610456 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610459 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610461 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610464 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610467 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610469 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 13:46:13.618456 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610472 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610475 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610477 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610480 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610484 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610487 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610490 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610492 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610496 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610499 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610501 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610504 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610507 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610511 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610514 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610517 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610519 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610522 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610524 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610527 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 13:46:13.618934 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610531 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610534 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610536 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610539 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610542 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610544 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610547 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610550 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610552 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610555 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610558 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610560 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610563 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610566 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610568 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610570 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610574 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610577 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610580 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 13:46:13.619415 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610582 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610585 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610588 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610590 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610593 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610595 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610598 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610600 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610603 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610605 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610607 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610610 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610612 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610617 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610619 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610622 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610625 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610628 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610630 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610633 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 13:46:13.619864 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610636 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610638 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610641 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610643 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610646 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610648 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610651 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610653 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610655 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610673 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610676 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610678 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610681 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610683 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610688 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610692 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610694 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 13:46:13.620353 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.610697 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.611784 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.618766 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.618783 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.619498 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.619513 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619577 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619581 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619585 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619589 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619592 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619594 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619597 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619600 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619602 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 13:46:13.620766 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619605 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619608 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619610 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619613 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619615 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619618 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619620 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619623 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619625 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619628 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619631 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619633 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619636 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619638 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619641 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619643 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619646 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619648 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619651 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619653 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 13:46:13.621148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619662 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619665 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619667 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619671 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619675 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619679 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619682 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619684 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619687 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619689 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619692 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619695 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619697 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619700 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619702 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619705 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619707 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619710 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619713 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 13:46:13.621619 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619715 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619718 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619721 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619724 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619726 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619729 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619731 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619734 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619737 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619740 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619744 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619747 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619750 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619752 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619760 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619763 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619767 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619770 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619773 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 13:46:13.622082 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619776 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619779 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619781 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619784 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619786 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619789 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619791 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619794 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619796 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619799 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619801 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619804 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619806 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619809 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619811 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619814 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619817 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619820 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619822 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619825 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 13:46:13.622531 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619828 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619830 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619833 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619835 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619838 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619841 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619843 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619845 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619856 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619859 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619861 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.619863 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.619869 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620029 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620036 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 13:46:13.623064 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620039 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620042 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620045 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620048 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620051 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620054 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620057 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620059 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620062 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620065 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620067 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620070 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620072 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620075 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620078 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620080 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620083 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620085 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620088 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620090 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 13:46:13.623432 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620093 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620095 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620098 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620100 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620103 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620105 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620114 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620116 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620119 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620121 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620124 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620127 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620129 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620132 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620134 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620137 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620140 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620142 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620145 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620147 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620150 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 13:46:13.623936 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620152 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620155 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620157 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620160 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620162 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620165 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620167 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620169 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620172 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620175 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620177 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620180 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620182 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620184 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620187 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620191 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620194 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620197 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620206 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 13:46:13.624433 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620209 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620212 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620215 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620217 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620220 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620222 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620225 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620228 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620231 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620233 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620235 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620238 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620240 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620243 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620246 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620248 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620250 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620253 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620255 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 13:46:13.624887 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620258 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620260 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620264 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620267 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620270 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620272 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620275 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620277 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620279 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620282 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620284 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620289 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620294 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620302 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620305 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620307 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620311 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 13:46:13.625357 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:13.620314 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 13:46:13.625762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.620319 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 13:46:13.625762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.620454 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 13:46:13.625762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.622474 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 13:46:13.625762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.623684 2556 server.go:1019] "Starting client certificate rotation" Jul 22 13:46:13.625762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.623778 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 13:46:13.625762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.623810 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 13:46:13.626067 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.625947 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 13:46:13.631838 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.631817 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 13:46:13.642510 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.642489 2556 log.go:25] "Validated CRI v1 runtime API" Jul 22 13:46:13.644495 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.644482 2556 log.go:25] "Validated CRI v1 image API" Jul 22 13:46:13.645202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.645187 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 13:46:13.647523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.647494 2556 fs.go:135] Filesystem UUIDs: map[3d2d8b6c-b743-49af-8607-ea555a9a3a81:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b1bc0175-f806-4351-a87f-379e1e247e0d:/dev/nvme0n1p4] Jul 22 13:46:13.647619 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.647522 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 13:46:13.652989 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.652858 2556 manager.go:216] Machine: {Timestamp:2026-07-22 13:46:13.651523495 +0000 UTC m=+0.301539526 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100644 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28bcc48a05bed1a707b9cbb4a70eab SystemUUID:ec28bcc4-8a05-bed1-a707-b9cbb4a70eab BootID:0a79a012-94fa-478a-9fb6-69c31a6d3a32 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:6c:6d:e8:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:6c:6d:e8:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:7e:fa:2a:e6:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 13:46:13.652989 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.652980 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 13:46:13.653160 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.653141 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 13:46:13.654828 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.654810 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 13:46:13.655860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.655833 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 13:46:13.656012 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.655863 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 13:46:13.656628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.656617 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 13:46:13.656665 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.656630 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 13:46:13.656665 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.656637 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 13:46:13.657290 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.657279 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 13:46:13.659749 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.659738 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 13:46:13.663765 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663753 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 22 13:46:13.663875 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663866 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 13:46:13.663922 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663895 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 22 13:46:13.663922 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663919 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 13:46:13.663988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663934 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 13:46:13.663988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663956 2556 kubelet.go:398] "Adding apiserver pod source" Jul 22 13:46:13.663988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.663970 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 13:46:13.664362 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.664351 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 13:46:13.664407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.664368 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 13:46:13.666356 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.666340 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 13:46:13.668047 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.668034 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 13:46:13.668089 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.668064 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 13:46:13.669554 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669537 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 13:46:13.669554 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669554 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 13:46:13.669554 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669561 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669567 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669575 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669581 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669589 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669595 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669602 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669607 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669616 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 13:46:13.669753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.669621 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 13:46:13.670363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.670352 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 13:46:13.670363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.670363 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 13:46:13.673528 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.673513 2556 server.go:1268] "Started kubelet" Jul 22 13:46:13.673973 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.673930 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 13:46:13.674641 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.674515 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 13:46:13.674641 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.674618 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 13:46:13.674782 ip-10-0-140-215 systemd[1]: Started Kubernetes Kubelet. Jul 22 13:46:13.675324 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.675306 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 13:46:13.675615 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.675576 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 13:46:13.675728 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.675689 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 13:46:13.676446 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.676427 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 13:46:13.677288 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.677268 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 22 13:46:13.679540 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.679522 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 13:46:13.683261 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.682453 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2db82bab6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.673482934 +0000 UTC m=+0.323498965,LastTimestamp:2026-07-22 13:46:13.673482934 +0000 UTC m=+0.323498965,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.683561 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.683546 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 13:46:13.683617 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.683564 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 13:46:13.683799 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.683773 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:13.684327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684310 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 13:46:13.684327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684321 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 13:46:13.684465 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684337 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 13:46:13.684465 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684425 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 22 13:46:13.684465 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684432 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 22 13:46:13.684602 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684593 2556 factory.go:153] Registering CRI-O factory Jul 22 13:46:13.684646 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684607 2556 factory.go:223] Registration of the crio container factory successfully Jul 22 13:46:13.684692 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684647 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 13:46:13.684692 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684653 2556 factory.go:55] Registering systemd factory Jul 22 13:46:13.684692 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684658 2556 factory.go:223] Registration of the systemd container factory successfully Jul 22 13:46:13.684692 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684674 2556 factory.go:103] Registering Raw factory Jul 22 13:46:13.684692 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.684684 2556 manager.go:1196] Started watching for new ooms in manager Jul 22 13:46:13.685058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.685046 2556 manager.go:349] Starting recovery of all containers Jul 22 13:46:13.695107 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.695090 2556 manager.go:354] Recovery completed Jul 22 13:46:13.699210 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.699198 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.700882 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.700863 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.700995 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.700896 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.700995 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.700926 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.701487 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.701470 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 13:46:13.701487 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.701487 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 13:46:13.701608 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.701475 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.701608 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.701502 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 22 13:46:13.701697 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.701660 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 13:46:13.701764 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.701743 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 13:46:13.702195 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.702177 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.702299 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.702205 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.702299 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.702216 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.703658 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.703646 2556 policy_none.go:49] "None policy: Start" Jul 22 13:46:13.703707 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.703662 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 13:46:13.703707 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.703673 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 13:46:13.705622 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.705610 2556 policy_none.go:47] "Start" Jul 22 13:46:13.705711 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.705563 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2dd24cbfa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.700881402 +0000 UTC m=+0.350897439,LastTimestamp:2026-07-22 13:46:13.700881402 +0000 UTC m=+0.350897439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.711454 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.711378 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2dd25588d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-215.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.700917389 +0000 UTC m=+0.350933424,LastTimestamp:2026-07-22 13:46:13.700917389 +0000 UTC m=+0.350933424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.717043 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.716987 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2dd258bfe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-215.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.700930558 +0000 UTC m=+0.350946589,LastTimestamp:2026-07-22 13:46:13.700930558 +0000 UTC m=+0.350946589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.720202 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.720146 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-215.ec2.internal.18c4a0a2dd24cbfa\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2dd24cbfa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.700881402 +0000 UTC m=+0.350897439,LastTimestamp:2026-07-22 13:46:13.702193912 +0000 UTC m=+0.352209942,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.727682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.727552 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gcf8v" Jul 22 13:46:13.729976 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.729887 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-215.ec2.internal.18c4a0a2dd25588d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2dd25588d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-215.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.700917389 +0000 UTC m=+0.350933424,LastTimestamp:2026-07-22 13:46:13.702209866 +0000 UTC m=+0.352225898,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.738371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.738354 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gcf8v" Jul 22 13:46:13.740086 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.740027 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-215.ec2.internal.18c4a0a2dd258bfe\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-215.ec2.internal.18c4a0a2dd258bfe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-215.ec2.internal,UID:ip-10-0-140-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-215.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-215.ec2.internal,},FirstTimestamp:2026-07-22 13:46:13.700930558 +0000 UTC m=+0.350946589,LastTimestamp:2026-07-22 13:46:13.702219729 +0000 UTC m=+0.352235760,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-215.ec2.internal,}" Jul 22 13:46:13.755513 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.755500 2556 manager.go:337] "Starting Device Plugin manager" Jul 22 13:46:13.755596 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.755530 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 13:46:13.755596 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.755540 2556 server.go:87] "Starting device plugin registration server" Jul 22 13:46:13.755801 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.755790 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 13:46:13.755836 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.755804 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 13:46:13.755946 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.755930 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 13:46:13.756041 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.756022 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 13:46:13.756041 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.756034 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 13:46:13.756491 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.756470 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 13:46:13.756550 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.756530 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:13.813971 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.813930 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 13:46:13.816009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.815299 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 13:46:13.816009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.815334 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 13:46:13.816009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.815358 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 13:46:13.816009 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.815394 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 13:46:13.817981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.817963 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 13:46:13.856117 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.856072 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.857006 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.856991 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.857096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.857018 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.857096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.857028 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.857096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.857055 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.864303 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.864287 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.864388 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.864312 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-215.ec2.internal\": node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:13.897148 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.897124 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:13.916269 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.916237 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal"] Jul 22 13:46:13.916345 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.916305 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.917739 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.917724 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.917812 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.917750 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.917812 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.917763 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.920090 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920076 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.920242 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.920305 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920263 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.920847 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920832 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.920932 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920861 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.920932 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920875 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.921020 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.920872 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.921069 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.921029 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.921069 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.921041 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.923176 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.923161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.923251 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.923189 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 13:46:13.923856 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.923837 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientMemory" Jul 22 13:46:13.923953 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.923859 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 13:46:13.923953 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:13.923871 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeHasSufficientPID" Jul 22 13:46:13.938611 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.938589 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-215.ec2.internal\" not found" node="ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.942636 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.942621 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-215.ec2.internal\" not found" node="ip-10-0-140-215.ec2.internal" Jul 22 13:46:13.997788 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:13.997765 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:14.086532 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.086500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a99c5aa20611a1331579f8bee7746ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal\" (UID: \"8a99c5aa20611a1331579f8bee7746ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.086532 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.086533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a99c5aa20611a1331579f8bee7746ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal\" (UID: \"8a99c5aa20611a1331579f8bee7746ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.086741 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.086552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d30b98ba726d66fa41d78697b204c94a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-215.ec2.internal\" (UID: \"d30b98ba726d66fa41d78697b204c94a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.098432 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.098409 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:14.186738 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.186640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a99c5aa20611a1331579f8bee7746ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal\" (UID: \"8a99c5aa20611a1331579f8bee7746ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.186738 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.186696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a99c5aa20611a1331579f8bee7746ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal\" (UID: \"8a99c5aa20611a1331579f8bee7746ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.186895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.186753 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a99c5aa20611a1331579f8bee7746ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal\" (UID: \"8a99c5aa20611a1331579f8bee7746ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.186895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.186761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d30b98ba726d66fa41d78697b204c94a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-215.ec2.internal\" (UID: \"d30b98ba726d66fa41d78697b204c94a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.186895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.186812 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a99c5aa20611a1331579f8bee7746ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal\" (UID: \"8a99c5aa20611a1331579f8bee7746ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.186895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.186838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d30b98ba726d66fa41d78697b204c94a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-215.ec2.internal\" (UID: \"d30b98ba726d66fa41d78697b204c94a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.199469 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.199447 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:14.244011 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.243983 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.245200 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.245172 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.300256 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.300229 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:14.401341 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.401313 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:14.501545 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.501473 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-215.ec2.internal\" not found" Jul 22 13:46:14.516221 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.516198 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 13:46:14.584459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.584418 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.601384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.601360 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 13:46:14.603267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.603241 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" Jul 22 13:46:14.616783 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.616762 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 13:46:14.623417 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.623401 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 13:46:14.623531 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.623513 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 13:46:14.623573 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.623555 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 13:46:14.667083 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.667057 2556 apiserver.go:52] "Watching apiserver" Jul 22 13:46:14.684229 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.684206 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 13:46:14.685497 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.685478 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 13:46:14.685914 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.685891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf","openshift-image-registry/node-ca-7vhjw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal","openshift-multus/multus-additional-cni-plugins-54q87","openshift-multus/network-metrics-daemon-nwtfn","openshift-network-diagnostics/network-check-target-kj49c","kube-system/global-pull-secret-syncer-f8wgc","kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wtzqw","openshift-dns/node-resolver-dwm5b","openshift-multus/multus-gslpg","openshift-network-operator/iptables-alerter-7bxgp","openshift-ovn-kubernetes/ovnkube-node-p2c6s","kube-system/konnectivity-agent-jjqgj"] Jul 22 13:46:14.688513 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.688494 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.690661 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.690642 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fn5pz\"" Jul 22 13:46:14.690753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.690672 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.690753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.690674 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.690941 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.690908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.693051 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693030 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693266 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693278 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693269 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693316 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693341 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 13:46:14.693468 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.693341 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b69jc\"" Jul 22 13:46:14.695558 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.695538 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nl2gl\"" Jul 22 13:46:14.695789 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.695769 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 13:46:14.695789 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.695787 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 13:46:14.696769 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.696753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.698655 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.698637 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 13:46:14.698833 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.698822 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.699025 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.699006 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x9gbb\"" Jul 22 13:46:14.699162 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.699015 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 13:46:14.699162 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.699140 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 13:46:14.699301 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.699269 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.699496 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.699477 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:14.699585 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.699545 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:14.702283 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.702265 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:14.702360 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.702319 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:14.704787 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.704763 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 13:46:14.705374 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.705359 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.707357 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.707337 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.707445 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.707408 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.707493 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.707471 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g5tbn\"" Jul 22 13:46:14.708188 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.708172 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.710333 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.710316 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhzxq\"" Jul 22 13:46:14.710447 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.710339 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 13:46:14.710447 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.710318 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.710447 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.710320 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.711069 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.711050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.714156 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.714133 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7l4ft\"" Jul 22 13:46:14.714515 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.714497 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 13:46:14.714721 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.714675 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.714817 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.714746 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.715310 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.715291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.717497 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.717478 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 13:46:14.717625 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.717540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 13:46:14.717625 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.717567 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-26965\"" Jul 22 13:46:14.717625 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.717542 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 13:46:14.717959 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.717946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.719922 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.719903 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5l8tl\"" Jul 22 13:46:14.720090 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.719903 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 13:46:14.720436 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.720418 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.720527 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.720484 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:14.734222 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.734204 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gs92l" Jul 22 13:46:14.738539 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.738520 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 13:46:14.743145 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.743102 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 13:41:14 +0000 UTC" deadline="2028-05-09 00:26:09.245151256 +0000 UTC" Jul 22 13:46:14.743145 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.743138 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15754h39m54.502015839s" Jul 22 13:46:14.743145 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.743142 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gs92l" Jul 22 13:46:14.785257 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.785195 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 13:46:14.792036 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-cni-bin\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.792153 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysctl-d\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.792153 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysctl-conf\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.792153 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f83143e8-413e-4061-b544-0e23aa8d7808-serviceca\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.792153 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-systemd-units\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.792371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.792371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:14.792371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cecee1d6-f233-482a-91ee-357f4dd3feaa-cni-binary-copy\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.792371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14e7623c-8bd6-4052-8c88-4c1e606c862a-tmp-dir\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.792371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792317 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-kubernetes\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.792371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-tuned\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-ovnkube-script-lib\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-os-release\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-slash\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792546 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-k8s-cni-cncf-io\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-netns\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-kubelet-config\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792639 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-dbus\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvnw\" (UniqueName: \"kubernetes.io/projected/ea0d919b-48ea-4730-8381-e326935a4f59-kube-api-access-5lvnw\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.792682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-host\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-cni-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddcd6349-5960-4b1f-b1df-b4e8bccf773a-agent-certs\") pod \"konnectivity-agent-jjqgj\" (UID: \"ddcd6349-5960-4b1f-b1df-b4e8bccf773a\") " pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-device-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792946 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flfx7\" (UniqueName: \"kubernetes.io/projected/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-kube-api-access-flfx7\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.792976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-socket-dir-parent\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-run\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-os-release\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddcd6349-5960-4b1f-b1df-b4e8bccf773a-konnectivity-ca\") pod \"konnectivity-agent-jjqgj\" (UID: \"ddcd6349-5960-4b1f-b1df-b4e8bccf773a\") " pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-socket-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-etc-kubernetes\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-systemd\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-modprobe-d\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-hostroot\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793226 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793200 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-etc-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2wfc\" (UniqueName: \"kubernetes.io/projected/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-kube-api-access-j2wfc\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793241 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-system-cni-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-daemon-config\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-ovnkube-config\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea0d919b-48ea-4730-8381-e326935a4f59-ovn-node-metrics-cert\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14e7623c-8bd6-4052-8c88-4c1e606c862a-hosts-file\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-host-slash\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysconfig\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-systemd\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793412 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8m6p\" (UniqueName: \"kubernetes.io/projected/f83143e8-413e-4061-b544-0e23aa8d7808-kube-api-access-f8m6p\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-cnibin\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-tuning-conf-dir\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f83143e8-413e-4061-b544-0e23aa8d7808-host\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-cni-multus\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.793830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-kubelet\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793592 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-ovn\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmgxc\" (UniqueName: \"kubernetes.io/projected/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-kube-api-access-tmgxc\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793722 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6qx\" (UniqueName: \"kubernetes.io/projected/82467c1e-fa57-4ee3-a685-6928147a35c4-kube-api-access-wx6qx\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-cnibin\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-cni-bin\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-conf-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793813 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-multus-certs\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp96p\" (UniqueName: \"kubernetes.io/projected/cecee1d6-f233-482a-91ee-357f4dd3feaa-kube-api-access-xp96p\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793873 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-registration-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.793971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-sys-fs\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-node-log\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794027 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-cni-netd\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.794575 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-system-cni-dir\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-cni-binary-copy\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-var-lib-kubelet\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82467c1e-fa57-4ee3-a685-6928147a35c4-tmp\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-kubelet\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-run-netns\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-var-lib-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-env-overrides\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hkl\" (UniqueName: \"kubernetes.io/projected/45174043-1a3f-46e7-855d-c9690346a898-kube-api-access-68hkl\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-iptables-alerter-script\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794336 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-sys\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-lib-modules\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd9fp\" (UniqueName: \"kubernetes.io/projected/14e7623c-8bd6-4052-8c88-4c1e606c862a-kube-api-access-sd9fp\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.795116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.794399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-log-socket\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.865930 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:14.865892 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a99c5aa20611a1331579f8bee7746ba.slice/crio-50879839b967fe43da748dd18d7d55020ed7009f87d411e9408168958031a725 WatchSource:0}: Error finding container 50879839b967fe43da748dd18d7d55020ed7009f87d411e9408168958031a725: Status 404 returned error can't find the container with id 50879839b967fe43da748dd18d7d55020ed7009f87d411e9408168958031a725 Jul 22 13:46:14.870128 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.870108 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:46:14.876148 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:14.876125 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30b98ba726d66fa41d78697b204c94a.slice/crio-8ba94eadfcb02f188739f4cf1ef50231ccf7e395bb376d1c331063e12b492e66 WatchSource:0}: Error finding container 8ba94eadfcb02f188739f4cf1ef50231ccf7e395bb376d1c331063e12b492e66: Status 404 returned error can't find the container with id 8ba94eadfcb02f188739f4cf1ef50231ccf7e395bb376d1c331063e12b492e66 Jul 22 13:46:14.895147 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-kubernetes\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.895232 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-tuned\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.895232 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.895232 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895189 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-ovnkube-script-lib\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.895331 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895247 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.895331 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895249 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-kubernetes\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.895331 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-os-release\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.895331 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.895331 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895315 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-os-release\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-slash\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895350 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-slash\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-k8s-cni-cncf-io\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-netns\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895427 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-kubelet-config\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-dbus\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-k8s-cni-cncf-io\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895497 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 13:46:14.895523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-netns\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895534 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-kubelet-config\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvnw\" (UniqueName: \"kubernetes.io/projected/ea0d919b-48ea-4730-8381-e326935a4f59-kube-api-access-5lvnw\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-host\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-cni-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895662 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-dbus\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddcd6349-5960-4b1f-b1df-b4e8bccf773a-agent-certs\") pod \"konnectivity-agent-jjqgj\" (UID: \"ddcd6349-5960-4b1f-b1df-b4e8bccf773a\") " pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-host\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-device-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-cni-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895744 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flfx7\" (UniqueName: \"kubernetes.io/projected/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-kube-api-access-flfx7\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895811 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-socket-dir-parent\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-run\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-os-release\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddcd6349-5960-4b1f-b1df-b4e8bccf773a-konnectivity-ca\") pod \"konnectivity-agent-jjqgj\" (UID: \"ddcd6349-5960-4b1f-b1df-b4e8bccf773a\") " pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895910 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-device-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-socket-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-ovnkube-script-lib\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-etc-kubernetes\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-socket-dir-parent\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895992 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-run\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-systemd\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.895911 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896037 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-etc-kubernetes\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896068 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-systemd\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896081 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-os-release\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896104 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-socket-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-modprobe-d\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896150 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-hostroot\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.896169 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896220 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-hostroot\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.896895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896175 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-etc-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.896242 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:46:15.396218558 +0000 UTC m=+2.046234609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896266 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-modprobe-d\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2wfc\" (UniqueName: \"kubernetes.io/projected/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-kube-api-access-j2wfc\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-system-cni-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896311 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-etc-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896361 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-system-cni-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-daemon-config\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896414 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-ovnkube-config\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea0d919b-48ea-4730-8381-e326935a4f59-ovn-node-metrics-cert\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14e7623c-8bd6-4052-8c88-4c1e606c862a-hosts-file\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-host-slash\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysconfig\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14e7623c-8bd6-4052-8c88-4c1e606c862a-hosts-file\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-systemd\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8m6p\" (UniqueName: \"kubernetes.io/projected/f83143e8-413e-4061-b544-0e23aa8d7808-kube-api-access-f8m6p\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.897860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-cnibin\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896657 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-tuning-conf-dir\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f83143e8-413e-4061-b544-0e23aa8d7808-host\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-cni-multus\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-kubelet\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-ovn\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmgxc\" (UniqueName: \"kubernetes.io/projected/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-kube-api-access-tmgxc\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6qx\" (UniqueName: \"kubernetes.io/projected/82467c1e-fa57-4ee3-a685-6928147a35c4-kube-api-access-wx6qx\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896957 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-cnibin\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-cni-bin\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-conf-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-multus-certs\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-ovnkube-config\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897078 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f83143e8-413e-4061-b544-0e23aa8d7808-host\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp96p\" (UniqueName: \"kubernetes.io/projected/cecee1d6-f233-482a-91ee-357f4dd3feaa-kube-api-access-xp96p\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.896517 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddcd6349-5960-4b1f-b1df-b4e8bccf773a-konnectivity-ca\") pod \"konnectivity-agent-jjqgj\" (UID: \"ddcd6349-5960-4b1f-b1df-b4e8bccf773a\") " pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.898878 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-daemon-config\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-cni-multus\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-registration-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-sys-fs\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-cnibin\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897235 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-cni-bin\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-node-log\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897284 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-node-log\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897322 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-run-multus-certs\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897335 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-cni-netd\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897422 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-system-cni-dir\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897453 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-cni-binary-copy\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-var-lib-kubelet\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897496 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysconfig\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.900005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82467c1e-fa57-4ee3-a685-6928147a35c4-tmp\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-kubelet\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-tuning-conf-dir\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897555 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-systemd\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-multus-conf-dir\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897172 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-ovn\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-run-netns\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.897658 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-host-slash\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-host-var-lib-kubelet\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cecee1d6-f233-482a-91ee-357f4dd3feaa-cnibin\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.897709 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:46:15.397692485 +0000 UTC m=+2.047708505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897610 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-kubelet\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897715 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-registration-dir\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897727 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-sys-fs\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897762 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45174043-1a3f-46e7-855d-c9690346a898-system-cni-dir\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.900740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-var-lib-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897819 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-cni-netd\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897824 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-env-overrides\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-var-lib-kubelet\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68hkl\" (UniqueName: \"kubernetes.io/projected/45174043-1a3f-46e7-855d-c9690346a898-kube-api-access-68hkl\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-iptables-alerter-script\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.897955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-sys\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-sys\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-lib-modules\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45174043-1a3f-46e7-855d-c9690346a898-cni-binary-copy\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd9fp\" (UniqueName: \"kubernetes.io/projected/14e7623c-8bd6-4052-8c88-4c1e606c862a-kube-api-access-sd9fp\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898272 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-log-socket\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-run-netns\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898310 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-var-lib-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-cni-bin\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898361 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysctl-d\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901309 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysctl-conf\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f83143e8-413e-4061-b544-0e23aa8d7808-serviceca\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898428 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-log-socket\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898436 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea0d919b-48ea-4730-8381-e326935a4f59-env-overrides\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-systemd-units\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysctl-conf\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cecee1d6-f233-482a-91ee-357f4dd3feaa-cni-binary-copy\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14e7623c-8bd6-4052-8c88-4c1e606c862a-tmp-dir\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898612 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-iptables-alerter-script\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898389 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-lib-modules\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898668 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-run-openvswitch\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898593 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-systemd-units\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-sysctl-d\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.898711 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea0d919b-48ea-4730-8381-e326935a4f59-host-cni-bin\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.899022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14e7623c-8bd6-4052-8c88-4c1e606c862a-tmp-dir\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.899054 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f83143e8-413e-4061-b544-0e23aa8d7808-serviceca\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.901809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.899447 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cecee1d6-f233-482a-91ee-357f4dd3feaa-cni-binary-copy\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.902381 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.899618 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea0d919b-48ea-4730-8381-e326935a4f59-ovn-node-metrics-cert\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.902381 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.899836 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddcd6349-5960-4b1f-b1df-b4e8bccf773a-agent-certs\") pod \"konnectivity-agent-jjqgj\" (UID: \"ddcd6349-5960-4b1f-b1df-b4e8bccf773a\") " pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:14.902381 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.900441 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82467c1e-fa57-4ee3-a685-6928147a35c4-tmp\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.902381 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.900562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82467c1e-fa57-4ee3-a685-6928147a35c4-etc-tuned\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.908268 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.908245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flfx7\" (UniqueName: \"kubernetes.io/projected/c445f83e-5b24-4b2c-a25c-7b250a62d1d2-kube-api-access-flfx7\") pod \"aws-ebs-csi-driver-node-zwxpf\" (UID: \"c445f83e-5b24-4b2c-a25c-7b250a62d1d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:14.909473 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.909456 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvnw\" (UniqueName: \"kubernetes.io/projected/ea0d919b-48ea-4730-8381-e326935a4f59-kube-api-access-5lvnw\") pod \"ovnkube-node-p2c6s\" (UID: \"ea0d919b-48ea-4730-8381-e326935a4f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:14.913305 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.913282 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:14.913384 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.913308 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:14.913384 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.913324 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:14.913503 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:14.913389 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:46:15.413372365 +0000 UTC m=+2.063388391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:14.914640 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.914620 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmgxc\" (UniqueName: \"kubernetes.io/projected/edb8aa7f-b9bf-4fff-a383-4ce942f57da5-kube-api-access-tmgxc\") pod \"iptables-alerter-7bxgp\" (UID: \"edb8aa7f-b9bf-4fff-a383-4ce942f57da5\") " pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:14.915509 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.915484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hkl\" (UniqueName: \"kubernetes.io/projected/45174043-1a3f-46e7-855d-c9690346a898-kube-api-access-68hkl\") pod \"multus-additional-cni-plugins-54q87\" (UID: \"45174043-1a3f-46e7-855d-c9690346a898\") " pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:14.915628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.915577 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2wfc\" (UniqueName: \"kubernetes.io/projected/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-kube-api-access-j2wfc\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:14.915911 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.915892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8m6p\" (UniqueName: \"kubernetes.io/projected/f83143e8-413e-4061-b544-0e23aa8d7808-kube-api-access-f8m6p\") pod \"node-ca-7vhjw\" (UID: \"f83143e8-413e-4061-b544-0e23aa8d7808\") " pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:14.916442 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.916418 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6qx\" (UniqueName: \"kubernetes.io/projected/82467c1e-fa57-4ee3-a685-6928147a35c4-kube-api-access-wx6qx\") pod \"tuned-wtzqw\" (UID: \"82467c1e-fa57-4ee3-a685-6928147a35c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:14.917149 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.917128 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp96p\" (UniqueName: \"kubernetes.io/projected/cecee1d6-f233-482a-91ee-357f4dd3feaa-kube-api-access-xp96p\") pod \"multus-gslpg\" (UID: \"cecee1d6-f233-482a-91ee-357f4dd3feaa\") " pod="openshift-multus/multus-gslpg" Jul 22 13:46:14.917429 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:14.917413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd9fp\" (UniqueName: \"kubernetes.io/projected/14e7623c-8bd6-4052-8c88-4c1e606c862a-kube-api-access-sd9fp\") pod \"node-resolver-dwm5b\" (UID: \"14e7623c-8bd6-4052-8c88-4c1e606c862a\") " pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:15.026609 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.026517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dwm5b" Jul 22 13:46:15.037002 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.036978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:15.037312 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.037288 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e7623c_8bd6_4052_8c88_4c1e606c862a.slice/crio-1818cc4fbc3931b5ed93133f1ef64f368045ce0c2a055e1e6ce6535790f5e5b7 WatchSource:0}: Error finding container 1818cc4fbc3931b5ed93133f1ef64f368045ce0c2a055e1e6ce6535790f5e5b7: Status 404 returned error can't find the container with id 1818cc4fbc3931b5ed93133f1ef64f368045ce0c2a055e1e6ce6535790f5e5b7 Jul 22 13:46:15.046802 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.046734 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0d919b_48ea_4730_8381_e326935a4f59.slice/crio-fe5239fa84d519372a2ca6b87f458488774568478aa6e83e209d068e07c73e43 WatchSource:0}: Error finding container fe5239fa84d519372a2ca6b87f458488774568478aa6e83e209d068e07c73e43: Status 404 returned error can't find the container with id fe5239fa84d519372a2ca6b87f458488774568478aa6e83e209d068e07c73e43 Jul 22 13:46:15.056163 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.056145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:15.064163 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.064140 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcd6349_5960_4b1f_b1df_b4e8bccf773a.slice/crio-3d73cfd637eaa4498f576c76aedbc4846d1005cdfbfba9f62aa1fe8c0159a8a5 WatchSource:0}: Error finding container 3d73cfd637eaa4498f576c76aedbc4846d1005cdfbfba9f62aa1fe8c0159a8a5: Status 404 returned error can't find the container with id 3d73cfd637eaa4498f576c76aedbc4846d1005cdfbfba9f62aa1fe8c0159a8a5 Jul 22 13:46:15.070384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.070364 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-54q87" Jul 22 13:46:15.080840 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.080818 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45174043_1a3f_46e7_855d_c9690346a898.slice/crio-89f1488366e5d7ca57b3573f1daa7470b98c6797024f25b3c4e75124a3fa3090 WatchSource:0}: Error finding container 89f1488366e5d7ca57b3573f1daa7470b98c6797024f25b3c4e75124a3fa3090: Status 404 returned error can't find the container with id 89f1488366e5d7ca57b3573f1daa7470b98c6797024f25b3c4e75124a3fa3090 Jul 22 13:46:15.086252 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.086233 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" Jul 22 13:46:15.094185 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.094168 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82467c1e_fa57_4ee3_a685_6928147a35c4.slice/crio-2792d83fb67551a794ce0bff22f8ab11dcc5af782c3a60eea0deea025dbf6b27 WatchSource:0}: Error finding container 2792d83fb67551a794ce0bff22f8ab11dcc5af782c3a60eea0deea025dbf6b27: Status 404 returned error can't find the container with id 2792d83fb67551a794ce0bff22f8ab11dcc5af782c3a60eea0deea025dbf6b27 Jul 22 13:46:15.094707 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.094687 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bxgp" Jul 22 13:46:15.103165 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.103143 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb8aa7f_b9bf_4fff_a383_4ce942f57da5.slice/crio-160553086e4e19008fbb6b6f31f40df437405bfa6c230fd321ac39212cc9e304 WatchSource:0}: Error finding container 160553086e4e19008fbb6b6f31f40df437405bfa6c230fd321ac39212cc9e304: Status 404 returned error can't find the container with id 160553086e4e19008fbb6b6f31f40df437405bfa6c230fd321ac39212cc9e304 Jul 22 13:46:15.132990 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.132967 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7vhjw" Jul 22 13:46:15.139954 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.139937 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" Jul 22 13:46:15.141582 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.141561 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83143e8_413e_4061_b544_0e23aa8d7808.slice/crio-8a5eb7ee9119fa328abfbd79a90fa25467ca6f2b4e545d5965f9870a2c13c106 WatchSource:0}: Error finding container 8a5eb7ee9119fa328abfbd79a90fa25467ca6f2b4e545d5965f9870a2c13c106: Status 404 returned error can't find the container with id 8a5eb7ee9119fa328abfbd79a90fa25467ca6f2b4e545d5965f9870a2c13c106 Jul 22 13:46:15.143485 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.143467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gslpg" Jul 22 13:46:15.148133 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.148114 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc445f83e_5b24_4b2c_a25c_7b250a62d1d2.slice/crio-7a8ee81fbd4a6318f69e378a3eb6b4bef83338faf7539e34b296bff1f69f4165 WatchSource:0}: Error finding container 7a8ee81fbd4a6318f69e378a3eb6b4bef83338faf7539e34b296bff1f69f4165: Status 404 returned error can't find the container with id 7a8ee81fbd4a6318f69e378a3eb6b4bef83338faf7539e34b296bff1f69f4165 Jul 22 13:46:15.151938 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:15.151910 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecee1d6_f233_482a_91ee_357f4dd3feaa.slice/crio-66bd31fefe4022e2ca873134373e4c1361af37d039bc7edd747a033198f58f47 WatchSource:0}: Error finding container 66bd31fefe4022e2ca873134373e4c1361af37d039bc7edd747a033198f58f47: Status 404 returned error can't find the container with id 66bd31fefe4022e2ca873134373e4c1361af37d039bc7edd747a033198f58f47 Jul 22 13:46:15.186247 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.186220 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 13:46:15.403677 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.403593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:15.403677 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.403651 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:15.403882 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.403755 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:15.403882 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.403764 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:15.403882 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.403809 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:46:16.403795417 +0000 UTC m=+3.053811436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:15.403882 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.403822 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:46:16.403816296 +0000 UTC m=+3.053832315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:15.504456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.504424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:15.504640 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.504614 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:15.504640 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.504639 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:15.504855 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.504650 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:15.504855 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:15.504719 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:46:16.504702233 +0000 UTC m=+3.154718269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:15.685389 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.685299 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 13:46:15.746766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.746679 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 13:41:15 +0000 UTC" deadline="2028-04-02 15:39:27.083864286 +0000 UTC" Jul 22 13:46:15.746766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.746761 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14881h53m11.337107673s" Jul 22 13:46:15.821759 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.821698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"fe5239fa84d519372a2ca6b87f458488774568478aa6e83e209d068e07c73e43"} Jul 22 13:46:15.823265 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.823193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dwm5b" event={"ID":"14e7623c-8bd6-4052-8c88-4c1e606c862a","Type":"ContainerStarted","Data":"1818cc4fbc3931b5ed93133f1ef64f368045ce0c2a055e1e6ce6535790f5e5b7"} Jul 22 13:46:15.824408 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.824381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" event={"ID":"d30b98ba726d66fa41d78697b204c94a","Type":"ContainerStarted","Data":"8ba94eadfcb02f188739f4cf1ef50231ccf7e395bb376d1c331063e12b492e66"} Jul 22 13:46:15.825707 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.825676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" event={"ID":"8a99c5aa20611a1331579f8bee7746ba","Type":"ContainerStarted","Data":"50879839b967fe43da748dd18d7d55020ed7009f87d411e9408168958031a725"} Jul 22 13:46:15.826829 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.826801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gslpg" event={"ID":"cecee1d6-f233-482a-91ee-357f4dd3feaa","Type":"ContainerStarted","Data":"66bd31fefe4022e2ca873134373e4c1361af37d039bc7edd747a033198f58f47"} Jul 22 13:46:15.828071 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.828044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" event={"ID":"c445f83e-5b24-4b2c-a25c-7b250a62d1d2","Type":"ContainerStarted","Data":"7a8ee81fbd4a6318f69e378a3eb6b4bef83338faf7539e34b296bff1f69f4165"} Jul 22 13:46:15.829131 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.829108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vhjw" event={"ID":"f83143e8-413e-4061-b544-0e23aa8d7808","Type":"ContainerStarted","Data":"8a5eb7ee9119fa328abfbd79a90fa25467ca6f2b4e545d5965f9870a2c13c106"} Jul 22 13:46:15.830153 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.830133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bxgp" event={"ID":"edb8aa7f-b9bf-4fff-a383-4ce942f57da5","Type":"ContainerStarted","Data":"160553086e4e19008fbb6b6f31f40df437405bfa6c230fd321ac39212cc9e304"} Jul 22 13:46:15.831419 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.831397 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" event={"ID":"82467c1e-fa57-4ee3-a685-6928147a35c4","Type":"ContainerStarted","Data":"2792d83fb67551a794ce0bff22f8ab11dcc5af782c3a60eea0deea025dbf6b27"} Jul 22 13:46:15.832768 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.832717 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerStarted","Data":"89f1488366e5d7ca57b3573f1daa7470b98c6797024f25b3c4e75124a3fa3090"} Jul 22 13:46:15.833877 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:15.833856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjqgj" event={"ID":"ddcd6349-5960-4b1f-b1df-b4e8bccf773a","Type":"ContainerStarted","Data":"3d73cfd637eaa4498f576c76aedbc4846d1005cdfbfba9f62aa1fe8c0159a8a5"} Jul 22 13:46:16.413407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.412548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:16.413407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.412640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:16.413407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.412779 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:16.413407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.412848 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:46:18.412828083 +0000 UTC m=+5.062844128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:16.413407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.413304 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:16.413407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.413366 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:46:18.413349807 +0000 UTC m=+5.063365830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:16.514592 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.513844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:16.514592 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.514076 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:16.514592 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.514105 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:16.514592 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.514119 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:16.514592 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.514184 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:46:18.514164829 +0000 UTC m=+5.164180864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:16.747459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.747340 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 13:41:15 +0000 UTC" deadline="2028-02-09 03:57:59.974303245 +0000 UTC" Jul 22 13:46:16.747459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.747378 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13598h11m43.226929775s" Jul 22 13:46:16.817446 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.816817 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:16.817446 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.816953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:16.817446 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.817415 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:16.817736 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.817515 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:16.817736 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:16.817415 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:16.817736 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:16.817615 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:17.345885 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:17.345845 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 13:46:17.843183 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:17.843057 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" event={"ID":"8a99c5aa20611a1331579f8bee7746ba","Type":"ContainerStarted","Data":"6b74dac0af8c4599ab0d0d6d719deea202f6389713d8f9aaa80739ecdf2d28f0"} Jul 22 13:46:18.431935 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.431856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:18.432150 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.431965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:18.432150 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.432096 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:18.432301 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.432162 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:46:22.432140689 +0000 UTC m=+9.082156713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:18.432301 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.432279 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:18.432416 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.432326 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:46:22.432311173 +0000 UTC m=+9.082327204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:18.533091 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.533056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:18.533286 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.533265 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:18.533354 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.533295 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:18.533354 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.533310 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:18.533455 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.533382 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:46:22.533359911 +0000 UTC m=+9.183375932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:18.815945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.815842 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:18.816122 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.816000 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:18.816424 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.816405 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:18.816541 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.816520 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:18.816605 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.816597 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:18.816720 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:18.816702 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:18.849809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.849774 2556 generic.go:356] "Generic (PLEG): container finished" podID="8a99c5aa20611a1331579f8bee7746ba" containerID="6b74dac0af8c4599ab0d0d6d719deea202f6389713d8f9aaa80739ecdf2d28f0" exitCode=0 Jul 22 13:46:18.850271 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:18.849825 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" event={"ID":"8a99c5aa20611a1331579f8bee7746ba","Type":"ContainerDied","Data":"6b74dac0af8c4599ab0d0d6d719deea202f6389713d8f9aaa80739ecdf2d28f0"} Jul 22 13:46:20.816325 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:20.816291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:20.816834 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:20.816439 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:20.816834 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:20.816828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:20.816967 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:20.816931 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:20.817211 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:20.816996 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:20.817211 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:20.817070 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:22.467585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:22.467537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:22.468213 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:22.467635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:22.468213 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.467785 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:22.468213 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.467851 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:46:30.467831365 +0000 UTC m=+17.117847400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:22.468213 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.468076 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:22.468213 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.468149 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:46:30.468127694 +0000 UTC m=+17.118143723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:22.568709 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:22.568018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:22.568709 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.568233 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:22.568709 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.568261 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:22.568709 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.568274 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:22.568709 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.568339 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:46:30.56831757 +0000 UTC m=+17.218333594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:22.816584 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:22.816495 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:22.816756 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.816627 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:22.816756 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:22.816664 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:22.816884 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.816779 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:22.816884 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:22.816834 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:22.817098 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:22.816911 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:24.816099 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:24.815737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:24.816099 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:24.815774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:24.816099 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:24.815782 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:24.816099 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:24.815861 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:24.816099 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:24.815955 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:24.816099 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:24.816057 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:26.815632 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:26.815594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:26.815632 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:26.815618 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:26.816127 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:26.815600 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:26.816127 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:26.815697 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:26.816127 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:26.815802 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:26.816127 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:26.815896 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:28.816030 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:28.815998 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:28.816475 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:28.815998 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:28.816475 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:28.816006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:28.816475 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:28.816135 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:28.816475 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:28.816233 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:28.816475 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:28.816319 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:30.527514 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:30.527485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:30.528002 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:30.527540 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:30.528002 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.527650 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:30.528002 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.527677 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:30.528002 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.527718 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:46:46.527700616 +0000 UTC m=+33.177716635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:30.528002 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.527740 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:46:46.527730172 +0000 UTC m=+33.177746198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:30.628656 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:30.628629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:30.628826 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.628766 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:30.628826 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.628789 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:30.628826 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.628799 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:30.629029 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.628854 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:46:46.628835386 +0000 UTC m=+33.278851420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:30.816004 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:30.815918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:30.816178 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:30.815918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:30.816178 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.816061 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:30.816178 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:30.815918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:30.816178 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.816150 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:30.816379 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:30.816230 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:32.816624 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:32.816579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:32.817181 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:32.816639 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:32.817181 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:32.816639 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:32.817181 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:32.816722 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:32.817181 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:32.816808 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:32.817181 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:32.816891 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:34.815875 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:34.815836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:34.816352 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:34.815836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:34.816352 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:34.815976 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:34.816352 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:34.815836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:34.816352 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:34.816040 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:34.816352 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:34.816087 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:35.889228 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.888562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerStarted","Data":"4c967f45c289b9e636e87c83f89e48e8e7941f8215eb3fbaef7c2c7f8a7a41e0"} Jul 22 13:46:35.897242 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.897153 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjqgj" event={"ID":"ddcd6349-5960-4b1f-b1df-b4e8bccf773a","Type":"ContainerStarted","Data":"4a92a80a6305945696ee49196495f3127f45de2e73ffd90013caf344de5120a7"} Jul 22 13:46:35.903106 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.903077 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" event={"ID":"d30b98ba726d66fa41d78697b204c94a","Type":"ContainerStarted","Data":"9fe3b1d84b158c11b4f4a9f92ed60b394375ac0f41404e9b2afe8127f18dcd64"} Jul 22 13:46:35.905492 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.905435 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" event={"ID":"8a99c5aa20611a1331579f8bee7746ba","Type":"ContainerStarted","Data":"3e51b210724b217fc4db90a3e8782826915e10cf740bfd2d1b1c5fde6fd9361b"} Jul 22 13:46:35.907812 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.907726 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gslpg" event={"ID":"cecee1d6-f233-482a-91ee-357f4dd3feaa","Type":"ContainerStarted","Data":"be27a322367ec9b2b11462174a08cb8d4fdcc182f410840483d57408126ca981"} Jul 22 13:46:35.915546 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.915513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" event={"ID":"82467c1e-fa57-4ee3-a685-6928147a35c4","Type":"ContainerStarted","Data":"869956720c9f41044d4b35849e14e986b3bcaa187c6276482f32b3940aa1c4e7"} Jul 22 13:46:35.936520 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.936472 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gslpg" podStartSLOduration=1.367506908 podStartE2EDuration="21.936457868s" totalImagesPullingTime="20.56895096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:35.935964676 +0000 UTC m=+22.585980716" watchObservedRunningTime="2026-07-22 13:46:35.936457868 +0000 UTC m=+22.586473907" Jul 22 13:46:35.955767 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.953027 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dwm5b" podStartSLOduration=1.315852763 podStartE2EDuration="21.953004004s" totalImagesPullingTime="20.637151241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:35.951840889 +0000 UTC m=+22.601856930" watchObservedRunningTime="2026-07-22 13:46:35.953004004 +0000 UTC m=+22.603020045" Jul 22 13:46:35.973103 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.972855 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jjqgj" podStartSLOduration=15.175222245 podStartE2EDuration="21.972834393s" totalImagesPullingTime="6.797612148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:35.9722241 +0000 UTC m=+22.622240143" watchObservedRunningTime="2026-07-22 13:46:35.972834393 +0000 UTC m=+22.622850434" Jul 22 13:46:35.992851 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:35.992808 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wtzqw" podStartSLOduration=1.4102265680000001 podStartE2EDuration="21.992792614s" totalImagesPullingTime="20.582566046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:35.992624499 +0000 UTC m=+22.642640538" watchObservedRunningTime="2026-07-22 13:46:35.992792614 +0000 UTC m=+22.642808653" Jul 22 13:46:36.020175 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.020135 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-215.ec2.internal" podStartSLOduration=21.020119919 podStartE2EDuration="21.020119919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:36.020007061 +0000 UTC m=+22.670023100" watchObservedRunningTime="2026-07-22 13:46:36.020119919 +0000 UTC m=+22.670135960" Jul 22 13:46:36.068855 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.068813 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7vhjw" podStartSLOduration=1.5481409940000002 podStartE2EDuration="22.068798485s" totalImagesPullingTime="20.520657491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:36.068790565 +0000 UTC m=+22.718806606" watchObservedRunningTime="2026-07-22 13:46:36.068798485 +0000 UTC m=+22.718814542" Jul 22 13:46:36.069118 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.069085 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-215.ec2.internal" podStartSLOduration=21.069078616 podStartE2EDuration="21.069078616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:36.047577066 +0000 UTC m=+22.697593106" watchObservedRunningTime="2026-07-22 13:46:36.069078616 +0000 UTC m=+22.719094656" Jul 22 13:46:36.815900 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.815865 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:36.816202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.815994 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:36.816202 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:36.816008 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:36.816202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.816019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:36.816202 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:36.816077 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:36.816202 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:36.816162 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:36.920057 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.920022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"d74c05a64b6af15d559e2cf40d6828cdddd528f719f0ea5c7aec8c734a39ab6a"} Jul 22 13:46:36.920650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.920095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"951ee82329e78c44cc983fdcac0a83f2e98ed10809d8c5c64d6a93550a45fb7d"} Jul 22 13:46:36.920650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.920131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"fca704fba9b9efe067f8c344b9e1a150bc4e52f48fad45938e37546aa2291e21"} Jul 22 13:46:36.920650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.920168 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"9d5b83ddc5c5afd8ab2ecd6f8afb31cba79ad5a71cb363818a5449a6824f4ee3"} Jul 22 13:46:36.920650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.920206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"0e3abe6bba903d516c8a1cb4a5f65facf0f82f3665cdef174655c0cb96a5f1b6"} Jul 22 13:46:36.920650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.920248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"8bd139159af29969ad05cd182f6dfbaaedd2782b90d6e7e6338777b8b247ba6e"} Jul 22 13:46:36.921375 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.921352 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dwm5b" event={"ID":"14e7623c-8bd6-4052-8c88-4c1e606c862a","Type":"ContainerStarted","Data":"f154fa843ddea2ec258832dfb9976de013d2247937409fbe203607ffa9d7522d"} Jul 22 13:46:36.922744 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.922686 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" event={"ID":"c445f83e-5b24-4b2c-a25c-7b250a62d1d2","Type":"ContainerStarted","Data":"d59c2f8a474e47bb4ff596b4751b61c8593fa644761bd4436054cd7dc470bf64"} Jul 22 13:46:36.924002 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.923984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7vhjw" event={"ID":"f83143e8-413e-4061-b544-0e23aa8d7808","Type":"ContainerStarted","Data":"3670f59ba3e212d0837f8d7eadd29bca35d8b1b761d6f59d8b38c2c9cfd03ede"} Jul 22 13:46:36.925357 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.925339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bxgp" event={"ID":"edb8aa7f-b9bf-4fff-a383-4ce942f57da5","Type":"ContainerStarted","Data":"56c1aefb73da07d8be2731d23aa9a31da6e1f5d88697d13170a7f665ac1b4e3c"} Jul 22 13:46:36.926554 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.926532 2556 generic.go:356] "Generic (PLEG): container finished" podID="45174043-1a3f-46e7-855d-c9690346a898" containerID="4c967f45c289b9e636e87c83f89e48e8e7941f8215eb3fbaef7c2c7f8a7a41e0" exitCode=0 Jul 22 13:46:36.926641 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.926622 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerDied","Data":"4c967f45c289b9e636e87c83f89e48e8e7941f8215eb3fbaef7c2c7f8a7a41e0"} Jul 22 13:46:36.943518 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:36.943481 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bxgp" podStartSLOduration=13.363624505 podStartE2EDuration="22.943468385s" totalImagesPullingTime="9.57984388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:36.943346665 +0000 UTC m=+23.593362705" watchObservedRunningTime="2026-07-22 13:46:36.943468385 +0000 UTC m=+23.593484425" Jul 22 13:46:37.190693 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:37.190670 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 13:46:37.467841 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:37.467761 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:37.767339 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:37.767175 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T13:46:37.190688647Z","UUID":"8e3a9355-aa69-4c4b-a28e-4f41d2285093","Handler":null,"Name":"","Endpoint":""} Jul 22 13:46:37.769229 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:37.769207 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 13:46:37.769229 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:37.769251 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 13:46:37.931353 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:37.931318 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" event={"ID":"c445f83e-5b24-4b2c-a25c-7b250a62d1d2","Type":"ContainerStarted","Data":"32d1300d5045b9a8b7c61d6290d476e15832bb6bc260f7b7587bdeaa0c218d80"} Jul 22 13:46:38.421542 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.421504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:38.422218 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.422193 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:38.815957 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.815926 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:38.815957 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.815964 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:38.816173 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.815967 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:38.816173 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:38.816058 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:38.816173 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:38.816160 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:38.816319 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:38.816239 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:38.935932 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.935819 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" event={"ID":"c445f83e-5b24-4b2c-a25c-7b250a62d1d2","Type":"ContainerStarted","Data":"bc2f1c8897d27b49fc401374cfea56510110881bb8f1e656008d506fd8158e18"} Jul 22 13:46:38.939666 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.939614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"dd9cb5eb5898cc04f6b856230001b6e79869f297eea287667ce0c6fa0413472e"} Jul 22 13:46:38.940200 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.940179 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jjqgj" Jul 22 13:46:38.959257 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:38.959213 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwxpf" podStartSLOduration=1.895193462 podStartE2EDuration="24.959195269s" totalImagesPullingTime="23.064001807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:38.958603335 +0000 UTC m=+25.608619394" watchObservedRunningTime="2026-07-22 13:46:38.959195269 +0000 UTC m=+25.609211404" Jul 22 13:46:40.816021 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:40.815797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:40.816407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:40.815832 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:40.816407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:40.816115 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:40.816407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:40.816183 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:40.816407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:40.815835 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:40.816407 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:40.816265 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:41.949581 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.949241 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" event={"ID":"ea0d919b-48ea-4730-8381-e326935a4f59","Type":"ContainerStarted","Data":"6ed4e0154fba90a0a8362edade2ffe826deefad5fc550535e21fdf728175542e"} Jul 22 13:46:41.949581 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.949556 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:41.950323 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.949617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:41.951391 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.951356 2556 generic.go:356] "Generic (PLEG): container finished" podID="45174043-1a3f-46e7-855d-c9690346a898" containerID="166433d6c2311a8334a7058234d4b7a2b766c6513167ee89cc1c94b8725095d8" exitCode=0 Jul 22 13:46:41.951391 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.951388 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerDied","Data":"166433d6c2311a8334a7058234d4b7a2b766c6513167ee89cc1c94b8725095d8"} Jul 22 13:46:41.965622 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.965602 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:41.982168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:41.982122 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" podStartSLOduration=7.287815591 podStartE2EDuration="27.982107463s" totalImagesPullingTime="20.694291872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:41.982042815 +0000 UTC m=+28.632058855" watchObservedRunningTime="2026-07-22 13:46:41.982107463 +0000 UTC m=+28.632123485" Jul 22 13:46:42.816367 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:42.816336 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:42.816367 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:42.816373 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:42.816629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:42.816347 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:42.816629 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:42.816460 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:42.816629 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:42.816577 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:42.816770 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:42.816717 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:42.954710 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:42.954684 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:42.971256 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:42.971222 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:46:43.209405 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:43.209369 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f8wgc"] Jul 22 13:46:43.209580 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:43.209482 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:43.209625 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:43.209579 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:43.211704 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:43.211681 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nwtfn"] Jul 22 13:46:43.211800 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:43.211762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:43.211850 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:43.211834 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:43.214585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:43.214559 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kj49c"] Jul 22 13:46:43.214708 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:43.214649 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:43.214770 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:43.214746 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:44.815802 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:44.815770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:44.816247 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:44.815881 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:44.816247 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:44.815896 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:44.816247 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:44.815948 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:44.816247 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:44.816079 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:44.816247 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:44.816152 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:45.964284 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:45.964113 2556 generic.go:356] "Generic (PLEG): container finished" podID="45174043-1a3f-46e7-855d-c9690346a898" containerID="2e4e317489aacd24fd2d94dc7502f7dd8d3609a5e409bf25e9c0be74027587a8" exitCode=0 Jul 22 13:46:45.964284 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:45.964189 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerDied","Data":"2e4e317489aacd24fd2d94dc7502f7dd8d3609a5e409bf25e9c0be74027587a8"} Jul 22 13:46:46.540015 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.539976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:46.540173 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.540062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:46.540173 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.540138 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:46.540173 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.540159 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:46.540305 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.540207 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs podName:ccdb417f-ddd0-4369-82a7-ce3ac406a7ae nodeName:}" failed. No retries permitted until 2026-07-22 13:47:18.540193412 +0000 UTC m=+65.190209431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs") pod "network-metrics-daemon-nwtfn" (UID: "ccdb417f-ddd0-4369-82a7-ce3ac406a7ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 13:46:46.540305 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.540223 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret podName:bce330f2-bfcc-4b90-ac12-e548ce40c0ba nodeName:}" failed. No retries permitted until 2026-07-22 13:47:18.540214756 +0000 UTC m=+65.190230774 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret") pod "global-pull-secret-syncer-f8wgc" (UID: "bce330f2-bfcc-4b90-ac12-e548ce40c0ba") : object "kube-system"/"original-pull-secret" not registered Jul 22 13:46:46.641300 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.641271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:46.641438 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.641417 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 13:46:46.641438 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.641434 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 13:46:46.641514 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.641443 2556 projected.go:196] Error preparing data for projected volume kube-api-access-9f7hw for pod openshift-network-diagnostics/network-check-target-kj49c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:46.641514 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.641492 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw podName:27c8effe-0aa3-4148-a398-2400ed512c9c nodeName:}" failed. No retries permitted until 2026-07-22 13:47:18.641477894 +0000 UTC m=+65.291493911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9f7hw" (UniqueName: "kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw") pod "network-check-target-kj49c" (UID: "27c8effe-0aa3-4148-a398-2400ed512c9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 13:46:46.815639 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.815609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:46.815809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.815627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:46.815809 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.815718 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:46.815809 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.815728 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f8wgc" podUID="bce330f2-bfcc-4b90-ac12-e548ce40c0ba" Jul 22 13:46:46.815809 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.815792 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nwtfn" podUID="ccdb417f-ddd0-4369-82a7-ce3ac406a7ae" Jul 22 13:46:46.816004 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:46.815852 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kj49c" podUID="27c8effe-0aa3-4148-a398-2400ed512c9c" Jul 22 13:46:46.968790 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.968755 2556 generic.go:356] "Generic (PLEG): container finished" podID="45174043-1a3f-46e7-855d-c9690346a898" containerID="d3d1f550a3ee90843c8f0d148c75345e5d84743f95bc923c68987b09c5e93a06" exitCode=0 Jul 22 13:46:46.969153 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:46.968822 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerDied","Data":"d3d1f550a3ee90843c8f0d148c75345e5d84743f95bc923c68987b09c5e93a06"} Jul 22 13:46:48.707503 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.707471 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-215.ec2.internal" event="NodeReady" Jul 22 13:46:48.708135 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.707635 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 13:46:48.741752 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.741604 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh"] Jul 22 13:46:48.744385 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.744327 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7854fd8576-rgm7n"] Jul 22 13:46:48.745139 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.745101 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.747448 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.747422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pwm5d\"" Jul 22 13:46:48.747701 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.747682 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 13:46:48.747808 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.747705 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.747967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.747945 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 13:46:48.747967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.747958 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.748458 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.748436 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj"] Jul 22 13:46:48.748577 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.748558 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.750849 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.750591 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 13:46:48.750849 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.750678 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 13:46:48.750849 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.750706 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 13:46:48.751053 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.750972 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sqdjp\"" Jul 22 13:46:48.751289 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.751274 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-f6z4g"] Jul 22 13:46:48.751425 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.751408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.753488 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.753470 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 13:46:48.753984 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.753788 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 13:46:48.753984 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.753866 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b8tqm\"" Jul 22 13:46:48.754155 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.754092 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg"] Jul 22 13:46:48.754252 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.754232 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.754378 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.754283 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.754378 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.754318 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.757373 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.757353 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 13:46:48.757507 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.757487 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.757736 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.757719 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.759435 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.757745 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g7qzd\"" Jul 22 13:46:48.759435 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.758331 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 13:46:48.759695 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.759678 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n"] Jul 22 13:46:48.764187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.761640 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.764187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.762028 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 13:46:48.766342 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.765980 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.766342 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.766180 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 13:46:48.766342 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.766273 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 13:46:48.766342 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.766294 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.767219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.766426 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6khfm\"" Jul 22 13:46:48.769254 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.769236 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8"] Jul 22 13:46:48.769423 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.769401 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:48.769597 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.769577 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 13:46:48.771667 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.771632 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 13:46:48.771841 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.771660 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.771936 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.771772 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.772117 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.772102 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sqrn8\"" Jul 22 13:46:48.772551 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.772520 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b4f55cfd4-s2c5b"] Jul 22 13:46:48.773252 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.773235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" Jul 22 13:46:48.775472 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.775457 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.775747 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.775725 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-59rgx\"" Jul 22 13:46:48.775841 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.775675 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.776540 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.776523 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj"] Jul 22 13:46:48.776658 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.776558 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg"] Jul 22 13:46:48.776658 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.776582 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7854fd8576-rgm7n"] Jul 22 13:46:48.776658 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.776601 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh"] Jul 22 13:46:48.776658 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.776622 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-279dc"] Jul 22 13:46:48.780080 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.777171 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.780080 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.779096 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.780080 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.779381 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jv299\"" Jul 22 13:46:48.780080 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.779655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 13:46:48.780379 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.780094 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 13:46:48.780379 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.780358 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 13:46:48.780607 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.780587 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.781372 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.781345 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 13:46:48.785006 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.784989 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:48.786540 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.785646 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-w52s6"] Jul 22 13:46:48.787788 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.787764 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 13:46:48.787897 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.787874 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5knn8\"" Jul 22 13:46:48.788139 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.788122 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 13:46:48.789598 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.789580 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc"] Jul 22 13:46:48.789756 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.789732 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:48.792760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.792738 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b4f55cfd4-s2c5b"] Jul 22 13:46:48.792945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.792901 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bjxbr"] Jul 22 13:46:48.793347 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.793314 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.793480 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.793460 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.793776 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.793758 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 13:46:48.793942 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.793896 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" Jul 22 13:46:48.795632 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.795608 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gxn6w\"" Jul 22 13:46:48.798644 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.798624 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 13:46:48.799338 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.799314 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.800494 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.800476 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9bxqj\"" Jul 22 13:46:48.801074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.800575 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.801408 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.801370 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5gk7m"] Jul 22 13:46:48.801509 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.801495 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:48.803711 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.803466 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 13:46:48.803711 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.803720 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 13:46:48.804023 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.804008 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vvhl\"" Jul 22 13:46:48.806007 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.805982 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 13:46:48.806097 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806071 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8"] Jul 22 13:46:48.806148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806104 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-w52s6"] Jul 22 13:46:48.806148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806123 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-279dc"] Jul 22 13:46:48.806239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806154 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-f6z4g"] Jul 22 13:46:48.806239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806173 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5gk7m"] Jul 22 13:46:48.806239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806185 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bjxbr"] Jul 22 13:46:48.806239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806205 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n"] Jul 22 13:46:48.806239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806227 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc"] Jul 22 13:46:48.806682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.806325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:48.808347 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.808328 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 13:46:48.808606 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.808588 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 13:46:48.808754 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.808733 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8c66\"" Jul 22 13:46:48.808866 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.808637 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 13:46:48.816258 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.816240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:46:48.816456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.816436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:46:48.816587 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.816573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:46:48.818600 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.818579 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 13:46:48.818781 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.818761 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phx9h\"" Jul 22 13:46:48.818953 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.818814 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 13:46:48.819275 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.819136 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6npf\"" Jul 22 13:46:48.858093 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-bound-sa-token\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.858209 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.858209 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-tmp\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.858209 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.858209 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6zx\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-kube-api-access-xm6zx\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858217 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ad905e1-ae67-4923-a0bc-9b22b5719667-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxlc8\" (UniqueName: \"kubernetes.io/projected/1151eeb0-1205-408d-b7a6-1385f6fbde5b-kube-api-access-fxlc8\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvq2v\" (UniqueName: \"kubernetes.io/projected/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-kube-api-access-nvq2v\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-serving-cert\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858393 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ad905e1-ae67-4923-a0bc-9b22b5719667-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5xr\" (UniqueName: \"kubernetes.io/projected/1f512068-94a8-4444-a270-fdd07bf20b9f-kube-api-access-7b5xr\") pod \"volume-data-source-validator-78cf4c6f6-ctbz8\" (UID: \"1f512068-94a8-4444-a270-fdd07bf20b9f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-snapshots\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdjwd\" (UniqueName: \"kubernetes.io/projected/05628bba-3c32-43e4-907e-f4edd8409f18-kube-api-access-fdjwd\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-trusted-ca\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858657 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:48.859058 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-default-certificate\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-stats-auth\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-certificates\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-image-registry-private-configuration\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-config\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.858976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvnz\" (UniqueName: \"kubernetes.io/projected/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-kube-api-access-7hvnz\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859010 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lczf7\" (UniqueName: \"kubernetes.io/projected/89be1ea5-8869-470b-b2fa-99123acfac17-kube-api-access-lczf7\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhdjz\" (UniqueName: \"kubernetes.io/projected/8ad905e1-ae67-4923-a0bc-9b22b5719667-kube-api-access-qhdjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859079 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-installation-pull-secrets\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-service-ca-bundle\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/154d4f5b-7c7b-430d-8336-34e4702777a4-ca-trust-extracted\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.859901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.859228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/89be1ea5-8869-470b-b2fa-99123acfac17-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.926367 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.926337 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:48.960135 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-snapshots\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.960135 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/815af2ec-bb4e-420a-8d20-4606191d093b-config-volume\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:48.960349 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.960349 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdjwd\" (UniqueName: \"kubernetes.io/projected/05628bba-3c32-43e4-907e-f4edd8409f18-kube-api-access-fdjwd\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.960349 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:48.960349 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-trusted-ca\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.960551 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960364 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:48.960551 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-default-certificate\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.960551 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-stats-auth\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.960954 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.960926 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 13:46:48.961062 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.961024 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls podName:1151eeb0-1205-408d-b7a6-1385f6fbde5b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.460993445 +0000 UTC m=+36.111009475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p798n" (UID: "1151eeb0-1205-408d-b7a6-1385f6fbde5b") : secret "samples-operator-tls" not found Jul 22 13:46:48.961387 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.960462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-certificates\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.961387 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961301 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w869q\" (UniqueName: \"kubernetes.io/projected/27834fe5-3551-41aa-ac25-232842ea5c5d-kube-api-access-w869q\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:48.961387 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961359 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-snapshots\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.961586 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dth6w\" (UniqueName: \"kubernetes.io/projected/79fb17a5-afb3-44fc-9f75-c883fc47a658-kube-api-access-dth6w\") pod \"network-check-source-7bc5b6bf85-6d7cc\" (UID: \"79fb17a5-afb3-44fc-9f75-c883fc47a658\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" Jul 22 13:46:48.961586 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-image-registry-private-configuration\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.961586 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvtj\" (UniqueName: \"kubernetes.io/projected/89c84897-b70f-4cda-a30c-4e2ca5393723-kube-api-access-qbvtj\") pod \"ingress-canary-5gk7m\" (UID: \"89c84897-b70f-4cda-a30c-4e2ca5393723\") " pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:48.961725 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-trusted-ca\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.961778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-config\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.961827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvnz\" (UniqueName: \"kubernetes.io/projected/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-kube-api-access-7hvnz\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.961827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-certificates\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.961827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lczf7\" (UniqueName: \"kubernetes.io/projected/89be1ea5-8869-470b-b2fa-99123acfac17-kube-api-access-lczf7\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.961987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/815af2ec-bb4e-420a-8d20-4606191d093b-tmp-dir\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:48.961987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhdjz\" (UniqueName: \"kubernetes.io/projected/8ad905e1-ae67-4923-a0bc-9b22b5719667-kube-api-access-qhdjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.961987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-installation-pull-secrets\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.961987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.961971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27834fe5-3551-41aa-ac25-232842ea5c5d-serving-cert\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:48.962168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw2nn\" (UniqueName: \"kubernetes.io/projected/815af2ec-bb4e-420a-8d20-4606191d093b-kube-api-access-cw2nn\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:48.962168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.962168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-service-ca-bundle\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.962168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/154d4f5b-7c7b-430d-8336-34e4702777a4-ca-trust-extracted\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.962168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/89be1ea5-8869-470b-b2fa-99123acfac17-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27834fe5-3551-41aa-ac25-232842ea5c5d-trusted-ca\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-bound-sa-token\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-tmp\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c84897-b70f-4cda-a30c-4e2ca5393723-cert\") pod \"ingress-canary-5gk7m\" (UID: \"89c84897-b70f-4cda-a30c-4e2ca5393723\") " pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962337 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-config\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.962383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.962724 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6zx\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-kube-api-access-xm6zx\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.962724 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.962451 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 13:46:48.962724 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.962505 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.462488366 +0000 UTC m=+36.112504401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : secret "router-metrics-certs-default" not found Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.964874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/154d4f5b-7c7b-430d-8336-34e4702777a4-ca-trust-extracted\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.965367 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-service-ca-bundle\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966292 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-image-registry-private-configuration\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966384 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/89be1ea5-8869-470b-b2fa-99123acfac17-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.966517 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.466501272 +0000 UTC m=+36.116517315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : configmap references non-existent config key: service-ca.crt Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-default-certificate\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.962455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/67b45d8b-2f40-44ec-89dc-340c7789aa24-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27834fe5-3551-41aa-ac25-232842ea5c5d-config\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ad905e1-ae67-4923-a0bc-9b22b5719667-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.966955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxlc8\" (UniqueName: \"kubernetes.io/projected/1151eeb0-1205-408d-b7a6-1385f6fbde5b-kube-api-access-fxlc8\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvq2v\" (UniqueName: \"kubernetes.io/projected/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-kube-api-access-nvq2v\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-serving-cert\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.969629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ad905e1-ae67-4923-a0bc-9b22b5719667-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5xr\" (UniqueName: \"kubernetes.io/projected/1f512068-94a8-4444-a270-fdd07bf20b9f-kube-api-access-7b5xr\") pod \"volume-data-source-validator-78cf4c6f6-ctbz8\" (UID: \"1f512068-94a8-4444-a270-fdd07bf20b9f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967260 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-installation-pull-secrets\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.967708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-stats-auth\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.968076 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.968139 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls podName:89be1ea5-8869-470b-b2fa-99123acfac17 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.468123557 +0000 UTC m=+36.118139578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w4zdg" (UID: "89be1ea5-8869-470b-b2fa-99123acfac17") : secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.968137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.968569 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.968585 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7854fd8576-rgm7n: secret "image-registry-tls" not found Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:48.968643 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls podName:154d4f5b-7c7b-430d-8336-34e4702777a4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.468627365 +0000 UTC m=+36.118643386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls") pod "image-registry-7854fd8576-rgm7n" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4") : secret "image-registry-tls" not found Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.969182 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ad905e1-ae67-4923-a0bc-9b22b5719667-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.969993 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ad905e1-ae67-4923-a0bc-9b22b5719667-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.970376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.970196 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-tmp\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.971038 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.970857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.974396 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.974313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdjwd\" (UniqueName: \"kubernetes.io/projected/05628bba-3c32-43e4-907e-f4edd8409f18-kube-api-access-fdjwd\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:48.974528 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.974477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-serving-cert\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.977966 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.977948 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-bound-sa-token\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:48.978421 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.978395 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvq2v\" (UniqueName: \"kubernetes.io/projected/640ef9f2-2838-45f8-baf1-c25fc2c0dc6e-kube-api-access-nvq2v\") pod \"service-ca-operator-5bcbc94c78-xd8xj\" (UID: \"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:48.978686 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.978642 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lczf7\" (UniqueName: \"kubernetes.io/projected/89be1ea5-8869-470b-b2fa-99123acfac17-kube-api-access-lczf7\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:48.978810 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.978793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvnz\" (UniqueName: \"kubernetes.io/projected/7eac1bf2-f413-4b2f-bf4e-e3018de6fa12-kube-api-access-7hvnz\") pod \"insights-operator-555d9d7885-f6z4g\" (UID: \"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12\") " pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:48.979198 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.979178 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhdjz\" (UniqueName: \"kubernetes.io/projected/8ad905e1-ae67-4923-a0bc-9b22b5719667-kube-api-access-qhdjz\") pod \"kube-storage-version-migrator-operator-7658d9b749-rg9gh\" (UID: \"8ad905e1-ae67-4923-a0bc-9b22b5719667\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:48.980116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.980093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxlc8\" (UniqueName: \"kubernetes.io/projected/1151eeb0-1205-408d-b7a6-1385f6fbde5b-kube-api-access-fxlc8\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:48.980223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.980160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5xr\" (UniqueName: \"kubernetes.io/projected/1f512068-94a8-4444-a270-fdd07bf20b9f-kube-api-access-7b5xr\") pod \"volume-data-source-validator-78cf4c6f6-ctbz8\" (UID: \"1f512068-94a8-4444-a270-fdd07bf20b9f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" Jul 22 13:46:48.980316 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:48.980296 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6zx\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-kube-api-access-xm6zx\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:49.046578 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.046549 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:49.059414 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.059389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" Jul 22 13:46:49.068286 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/67b45d8b-2f40-44ec-89dc-340c7789aa24-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:49.068286 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27834fe5-3551-41aa-ac25-232842ea5c5d-config\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.068473 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/815af2ec-bb4e-420a-8d20-4606191d093b-config-volume\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.068473 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.068473 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w869q\" (UniqueName: \"kubernetes.io/projected/27834fe5-3551-41aa-ac25-232842ea5c5d-kube-api-access-w869q\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.068473 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dth6w\" (UniqueName: \"kubernetes.io/projected/79fb17a5-afb3-44fc-9f75-c883fc47a658-kube-api-access-dth6w\") pod \"network-check-source-7bc5b6bf85-6d7cc\" (UID: \"79fb17a5-afb3-44fc-9f75-c883fc47a658\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" Jul 22 13:46:49.068663 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvtj\" (UniqueName: \"kubernetes.io/projected/89c84897-b70f-4cda-a30c-4e2ca5393723-kube-api-access-qbvtj\") pod \"ingress-canary-5gk7m\" (UID: \"89c84897-b70f-4cda-a30c-4e2ca5393723\") " pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:49.068703 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/815af2ec-bb4e-420a-8d20-4606191d093b-tmp-dir\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.068735 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27834fe5-3551-41aa-ac25-232842ea5c5d-serving-cert\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.068767 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw2nn\" (UniqueName: \"kubernetes.io/projected/815af2ec-bb4e-420a-8d20-4606191d093b-kube-api-access-cw2nn\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.068799 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:49.068833 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27834fe5-3551-41aa-ac25-232842ea5c5d-trusted-ca\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.068862 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.068849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c84897-b70f-4cda-a30c-4e2ca5393723-cert\") pod \"ingress-canary-5gk7m\" (UID: \"89c84897-b70f-4cda-a30c-4e2ca5393723\") " pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:49.069350 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.069031 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/815af2ec-bb4e-420a-8d20-4606191d093b-tmp-dir\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.069350 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.069122 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 13:46:49.069350 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.069200 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert podName:67b45d8b-2f40-44ec-89dc-340c7789aa24 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.569170797 +0000 UTC m=+36.219186832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-279dc" (UID: "67b45d8b-2f40-44ec-89dc-340c7789aa24") : secret "networking-console-plugin-cert" not found Jul 22 13:46:49.069350 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.069255 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27834fe5-3551-41aa-ac25-232842ea5c5d-config\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.069601 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.069355 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 13:46:49.069601 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.069412 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls podName:815af2ec-bb4e-420a-8d20-4606191d093b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.569395736 +0000 UTC m=+36.219411767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls") pod "dns-default-bjxbr" (UID: "815af2ec-bb4e-420a-8d20-4606191d093b") : secret "dns-default-metrics-tls" not found Jul 22 13:46:49.069601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.069485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/815af2ec-bb4e-420a-8d20-4606191d093b-config-volume\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.070165 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.070092 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27834fe5-3551-41aa-ac25-232842ea5c5d-trusted-ca\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.070264 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.070245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/67b45d8b-2f40-44ec-89dc-340c7789aa24-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:49.072024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.072002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89c84897-b70f-4cda-a30c-4e2ca5393723-cert\") pod \"ingress-canary-5gk7m\" (UID: \"89c84897-b70f-4cda-a30c-4e2ca5393723\") " pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:49.072024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.072015 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27834fe5-3551-41aa-ac25-232842ea5c5d-serving-cert\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.080108 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.080066 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dth6w\" (UniqueName: \"kubernetes.io/projected/79fb17a5-afb3-44fc-9f75-c883fc47a658-kube-api-access-dth6w\") pod \"network-check-source-7bc5b6bf85-6d7cc\" (UID: \"79fb17a5-afb3-44fc-9f75-c883fc47a658\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" Jul 22 13:46:49.080769 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.080656 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw2nn\" (UniqueName: \"kubernetes.io/projected/815af2ec-bb4e-420a-8d20-4606191d093b-kube-api-access-cw2nn\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.080769 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.080730 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w869q\" (UniqueName: \"kubernetes.io/projected/27834fe5-3551-41aa-ac25-232842ea5c5d-kube-api-access-w869q\") pod \"console-operator-565b7b569d-w52s6\" (UID: \"27834fe5-3551-41aa-ac25-232842ea5c5d\") " pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.080769 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.080766 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvtj\" (UniqueName: \"kubernetes.io/projected/89c84897-b70f-4cda-a30c-4e2ca5393723-kube-api-access-qbvtj\") pod \"ingress-canary-5gk7m\" (UID: \"89c84897-b70f-4cda-a30c-4e2ca5393723\") " pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:49.086436 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.086415 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" Jul 22 13:46:49.095782 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.095760 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" Jul 22 13:46:49.124515 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.124482 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" Jul 22 13:46:49.147935 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.146459 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:46:49.149186 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.149111 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" Jul 22 13:46:49.162320 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.162114 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5gk7m" Jul 22 13:46:49.276497 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.276463 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj"] Jul 22 13:46:49.287151 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.286349 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh"] Jul 22 13:46:49.296209 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:49.294685 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad905e1_ae67_4923_a0bc_9b22b5719667.slice/crio-9d3750ea39bfbc919314ada306975eeddc06d9dfdcbc4f4afd89e1a0338c31ce WatchSource:0}: Error finding container 9d3750ea39bfbc919314ada306975eeddc06d9dfdcbc4f4afd89e1a0338c31ce: Status 404 returned error can't find the container with id 9d3750ea39bfbc919314ada306975eeddc06d9dfdcbc4f4afd89e1a0338c31ce Jul 22 13:46:49.348680 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.346543 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-f6z4g"] Jul 22 13:46:49.355513 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:49.355466 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eac1bf2_f413_4b2f_bf4e_e3018de6fa12.slice/crio-2252da744b9b8142e2758ea3b173eec7645d28404229dda9cea7a0feb8bd4942 WatchSource:0}: Error finding container 2252da744b9b8142e2758ea3b173eec7645d28404229dda9cea7a0feb8bd4942: Status 404 returned error can't find the container with id 2252da744b9b8142e2758ea3b173eec7645d28404229dda9cea7a0feb8bd4942 Jul 22 13:46:49.381847 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.381777 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8"] Jul 22 13:46:49.388552 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:49.388504 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f512068_94a8_4444_a270_fdd07bf20b9f.slice/crio-db2779e76a4b4b2462431023fd3dc7f77d569e45a8c7707593a9272fafd3648c WatchSource:0}: Error finding container db2779e76a4b4b2462431023fd3dc7f77d569e45a8c7707593a9272fafd3648c: Status 404 returned error can't find the container with id db2779e76a4b4b2462431023fd3dc7f77d569e45a8c7707593a9272fafd3648c Jul 22 13:46:49.409557 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.409444 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5gk7m"] Jul 22 13:46:49.412446 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:49.412406 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c84897_b70f_4cda_a30c_4e2ca5393723.slice/crio-ed0971bdc7e0967bd1d3987eeafae26130f0aeee90e4cc25134859168a4bf003 WatchSource:0}: Error finding container ed0971bdc7e0967bd1d3987eeafae26130f0aeee90e4cc25134859168a4bf003: Status 404 returned error can't find the container with id ed0971bdc7e0967bd1d3987eeafae26130f0aeee90e4cc25134859168a4bf003 Jul 22 13:46:49.412803 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.412781 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-w52s6"] Jul 22 13:46:49.415860 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:49.415836 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27834fe5_3551_41aa_ac25_232842ea5c5d.slice/crio-869a59651a97156d751e494d098a185941d3487a885e04f4776c9d5992fbf945 WatchSource:0}: Error finding container 869a59651a97156d751e494d098a185941d3487a885e04f4776c9d5992fbf945: Status 404 returned error can't find the container with id 869a59651a97156d751e494d098a185941d3487a885e04f4776c9d5992fbf945 Jul 22 13:46:49.420817 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.420796 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc"] Jul 22 13:46:49.423622 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:46:49.423590 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fb17a5_afb3_44fc_9f75_c883fc47a658.slice/crio-64de0b7f3cca59f4200f5dfd6eb03c640296f8dd6a1187f453c21b95128b511d WatchSource:0}: Error finding container 64de0b7f3cca59f4200f5dfd6eb03c640296f8dd6a1187f453c21b95128b511d: Status 404 returned error can't find the container with id 64de0b7f3cca59f4200f5dfd6eb03c640296f8dd6a1187f453c21b95128b511d Jul 22 13:46:49.472982 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.472954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:49.473137 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.473030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:49.473137 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.473060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:49.473137 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.473085 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:49.473137 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.473121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473121 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473168 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473211 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473219 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.473197424 +0000 UTC m=+37.123213452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : configmap references non-existent config key: service-ca.crt Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473283 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473294 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7854fd8576-rgm7n: secret "image-registry-tls" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473283 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls podName:1151eeb0-1205-408d-b7a6-1385f6fbde5b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.473266077 +0000 UTC m=+37.123282101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p798n" (UID: "1151eeb0-1205-408d-b7a6-1385f6fbde5b") : secret "samples-operator-tls" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473343 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.473322574 +0000 UTC m=+37.123338606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : secret "router-metrics-certs-default" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473374 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls podName:89be1ea5-8869-470b-b2fa-99123acfac17 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.473361266 +0000 UTC m=+37.123377284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w4zdg" (UID: "89be1ea5-8869-470b-b2fa-99123acfac17") : secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:49.473484 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.473391 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls podName:154d4f5b-7c7b-430d-8336-34e4702777a4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.473381645 +0000 UTC m=+37.123397669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls") pod "image-registry-7854fd8576-rgm7n" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4") : secret "image-registry-tls" not found Jul 22 13:46:49.574244 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.574173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:49.574375 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.574307 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:49.574375 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.574324 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 13:46:49.574458 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.574387 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls podName:815af2ec-bb4e-420a-8d20-4606191d093b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.57437332 +0000 UTC m=+37.224389341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls") pod "dns-default-bjxbr" (UID: "815af2ec-bb4e-420a-8d20-4606191d093b") : secret "dns-default-metrics-tls" not found Jul 22 13:46:49.574458 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.574414 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 13:46:49.574458 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:49.574452 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert podName:67b45d8b-2f40-44ec-89dc-340c7789aa24 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:50.574441291 +0000 UTC m=+37.224457309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-279dc" (UID: "67b45d8b-2f40-44ec-89dc-340c7789aa24") : secret "networking-console-plugin-cert" not found Jul 22 13:46:49.982038 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.981999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" event={"ID":"79fb17a5-afb3-44fc-9f75-c883fc47a658","Type":"ContainerStarted","Data":"64de0b7f3cca59f4200f5dfd6eb03c640296f8dd6a1187f453c21b95128b511d"} Jul 22 13:46:49.983341 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.983315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" event={"ID":"27834fe5-3551-41aa-ac25-232842ea5c5d","Type":"ContainerStarted","Data":"869a59651a97156d751e494d098a185941d3487a885e04f4776c9d5992fbf945"} Jul 22 13:46:49.984594 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.984562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" event={"ID":"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e","Type":"ContainerStarted","Data":"8ec21a9c8e0533a207cecf94c7ad47f1f50bf169f955d9e9ddad38498997a8ee"} Jul 22 13:46:49.985810 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.985786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" event={"ID":"8ad905e1-ae67-4923-a0bc-9b22b5719667","Type":"ContainerStarted","Data":"9d3750ea39bfbc919314ada306975eeddc06d9dfdcbc4f4afd89e1a0338c31ce"} Jul 22 13:46:49.987318 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.987222 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5gk7m" event={"ID":"89c84897-b70f-4cda-a30c-4e2ca5393723","Type":"ContainerStarted","Data":"ed0971bdc7e0967bd1d3987eeafae26130f0aeee90e4cc25134859168a4bf003"} Jul 22 13:46:49.988816 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.988789 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" event={"ID":"1f512068-94a8-4444-a270-fdd07bf20b9f","Type":"ContainerStarted","Data":"db2779e76a4b4b2462431023fd3dc7f77d569e45a8c7707593a9272fafd3648c"} Jul 22 13:46:49.990127 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:49.990108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" event={"ID":"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12","Type":"ContainerStarted","Data":"2252da744b9b8142e2758ea3b173eec7645d28404229dda9cea7a0feb8bd4942"} Jul 22 13:46:50.455175 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.455136 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:50.484299 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.484264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:50.484453 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.484306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:50.484453 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.484344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:50.484453 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.484378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:50.484453 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484436 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.484413901 +0000 UTC m=+39.134429934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : configmap references non-existent config key: service-ca.crt Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484489 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484494 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484505 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484532 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.484520579 +0000 UTC m=+39.134536607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : secret "router-metrics-certs-default" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.484510 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484512 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7854fd8576-rgm7n: secret "image-registry-tls" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484567 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls podName:89be1ea5-8869-470b-b2fa-99123acfac17 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.484549052 +0000 UTC m=+39.134565070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w4zdg" (UID: "89be1ea5-8869-470b-b2fa-99123acfac17") : secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484570 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484590 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls podName:154d4f5b-7c7b-430d-8336-34e4702777a4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.484580267 +0000 UTC m=+39.134596287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls") pod "image-registry-7854fd8576-rgm7n" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4") : secret "image-registry-tls" not found Jul 22 13:46:50.484675 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.484609 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls podName:1151eeb0-1205-408d-b7a6-1385f6fbde5b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.484601947 +0000 UTC m=+39.134617966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p798n" (UID: "1151eeb0-1205-408d-b7a6-1385f6fbde5b") : secret "samples-operator-tls" not found Jul 22 13:46:50.585890 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.585860 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:50.586063 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.586043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:50.586063 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.586054 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 13:46:50.586188 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.586133 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls podName:815af2ec-bb4e-420a-8d20-4606191d093b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.58611108 +0000 UTC m=+39.236127102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls") pod "dns-default-bjxbr" (UID: "815af2ec-bb4e-420a-8d20-4606191d093b") : secret "dns-default-metrics-tls" not found Jul 22 13:46:50.586188 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.586135 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 13:46:50.586188 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:50.586182 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert podName:67b45d8b-2f40-44ec-89dc-340c7789aa24 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.586170481 +0000 UTC m=+39.236186500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-279dc" (UID: "67b45d8b-2f40-44ec-89dc-340c7789aa24") : secret "networking-console-plugin-cert" not found Jul 22 13:46:50.599429 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:50.599398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:52.004627 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.003630 2556 generic.go:356] "Generic (PLEG): container finished" podID="45174043-1a3f-46e7-855d-c9690346a898" containerID="691178ffb42bef967d037b37f789eda7854fc9bb7e1c4ea72cd6dfa30887d48c" exitCode=0 Jul 22 13:46:52.004627 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.003714 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerDied","Data":"691178ffb42bef967d037b37f789eda7854fc9bb7e1c4ea72cd6dfa30887d48c"} Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.505865 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.505996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.506033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.506070 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.506107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506265 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506280 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7854fd8576-rgm7n: secret "image-registry-tls" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506340 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls podName:154d4f5b-7c7b-430d-8336-34e4702777a4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.506320734 +0000 UTC m=+43.156336775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls") pod "image-registry-7854fd8576-rgm7n" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4") : secret "image-registry-tls" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506756 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506809 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls podName:1151eeb0-1205-408d-b7a6-1385f6fbde5b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.506793527 +0000 UTC m=+43.156809551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p798n" (UID: "1151eeb0-1205-408d-b7a6-1385f6fbde5b") : secret "samples-operator-tls" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506874 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.506863433 +0000 UTC m=+43.156879472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : configmap references non-existent config key: service-ca.crt Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506947 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.506979 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.506969258 +0000 UTC m=+43.156985281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : secret "router-metrics-certs-default" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.507028 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:52.507096 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.507060 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls podName:89be1ea5-8869-470b-b2fa-99123acfac17 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.507048291 +0000 UTC m=+43.157064313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w4zdg" (UID: "89be1ea5-8869-470b-b2fa-99123acfac17") : secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:52.608276 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.607313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:52.608276 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:52.607477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:52.608276 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.607646 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 13:46:52.608276 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.607714 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls podName:815af2ec-bb4e-420a-8d20-4606191d093b nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.607695686 +0000 UTC m=+43.257711706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls") pod "dns-default-bjxbr" (UID: "815af2ec-bb4e-420a-8d20-4606191d093b") : secret "dns-default-metrics-tls" not found Jul 22 13:46:52.608276 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.607801 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 13:46:52.608276 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:52.607847 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert podName:67b45d8b-2f40-44ec-89dc-340c7789aa24 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:56.607832393 +0000 UTC m=+43.257848416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-279dc" (UID: "67b45d8b-2f40-44ec-89dc-340c7789aa24") : secret "networking-console-plugin-cert" not found Jul 22 13:46:53.013869 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:53.013454 2556 generic.go:356] "Generic (PLEG): container finished" podID="45174043-1a3f-46e7-855d-c9690346a898" containerID="39f59447194901c8ac482009225ece4bd2b3ad3e1cd378bff84175fef18e99e0" exitCode=0 Jul 22 13:46:53.013869 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:53.013742 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerDied","Data":"39f59447194901c8ac482009225ece4bd2b3ad3e1cd378bff84175fef18e99e0"} Jul 22 13:46:54.032262 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:54.032217 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:54.133793 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:54.133706 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:55.222359 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:55.222269 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:55.297455 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:55.297424 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:55.368087 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:55.368052 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:56.545242 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.545207 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.545296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545368 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545384 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7854fd8576-rgm7n: secret "image-registry-tls" not found Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.545397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.545430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545445 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls podName:154d4f5b-7c7b-430d-8336-34e4702777a4 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.545424944 +0000 UTC m=+51.195440979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls") pod "image-registry-7854fd8576-rgm7n" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4") : secret "image-registry-tls" not found Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545470 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545512 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545554 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.545534198 +0000 UTC m=+51.195550218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : configmap references non-existent config key: service-ca.crt Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545574 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.545566785 +0000 UTC m=+51.195582803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : secret "router-metrics-certs-default" not found Jul 22 13:46:56.545619 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.545592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:46:56.545980 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545637 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls podName:1151eeb0-1205-408d-b7a6-1385f6fbde5b nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.545631884 +0000 UTC m=+51.195647902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p798n" (UID: "1151eeb0-1205-408d-b7a6-1385f6fbde5b") : secret "samples-operator-tls" not found Jul 22 13:46:56.545980 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545664 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:56.545980 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.545704 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls podName:89be1ea5-8869-470b-b2fa-99123acfac17 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.545692315 +0000 UTC m=+51.195708337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w4zdg" (UID: "89be1ea5-8869-470b-b2fa-99123acfac17") : secret "cluster-monitoring-operator-tls" not found Jul 22 13:46:56.646434 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.646403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:46:56.646577 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:56.646464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:46:56.646577 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.646563 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 13:46:56.646638 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.646578 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 13:46:56.646638 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.646629 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls podName:815af2ec-bb4e-420a-8d20-4606191d093b nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.64661295 +0000 UTC m=+51.296628982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls") pod "dns-default-bjxbr" (UID: "815af2ec-bb4e-420a-8d20-4606191d093b") : secret "dns-default-metrics-tls" not found Jul 22 13:46:56.646715 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:46:56.646643 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert podName:67b45d8b-2f40-44ec-89dc-340c7789aa24 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.646637175 +0000 UTC m=+51.296653193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-279dc" (UID: "67b45d8b-2f40-44ec-89dc-340c7789aa24") : secret "networking-console-plugin-cert" not found Jul 22 13:46:57.594606 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:57.594561 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:57.657322 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:57.657283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:46:58.990720 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:46:58.990690 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:00.037794 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.037756 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-54q87" event={"ID":"45174043-1a3f-46e7-855d-c9690346a898","Type":"ContainerStarted","Data":"3ff04e90f22f62ab51de0d4ebb03013b30c44ef813c837f60c1d47505415ab20"} Jul 22 13:47:00.039520 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.039471 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5gk7m" event={"ID":"89c84897-b70f-4cda-a30c-4e2ca5393723","Type":"ContainerStarted","Data":"806c8cd4403509c28d4970674ff2949baa7f14fc33c58435b9fda3c71f8cf245"} Jul 22 13:47:00.041234 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.041186 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" event={"ID":"1f512068-94a8-4444-a270-fdd07bf20b9f","Type":"ContainerStarted","Data":"a4a3e8c6590ca43f5352f916d88fadc0fac8dc5253c3ba5261ccfaf189228d9a"} Jul 22 13:47:00.042861 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.042805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" event={"ID":"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12","Type":"ContainerStarted","Data":"755ca5d06d5eff4dd9385c32e834f65598144e0333aaff88fd04d7bb9bb374ef"} Jul 22 13:47:00.044413 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.044389 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" event={"ID":"79fb17a5-afb3-44fc-9f75-c883fc47a658","Type":"ContainerStarted","Data":"485706931f909ed7088e7f224e3456b321a83c0b26e43f50980ac227b961f878"} Jul 22 13:47:00.046466 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.046446 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/0.log" Jul 22 13:47:00.046567 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.046485 2556 generic.go:356] "Generic (PLEG): container finished" podID="27834fe5-3551-41aa-ac25-232842ea5c5d" containerID="b598e615b996ee656b7ff582c460012b7da6048e4def9688e561842c75ad03f2" exitCode=255 Jul 22 13:47:00.046567 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.046513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" event={"ID":"27834fe5-3551-41aa-ac25-232842ea5c5d","Type":"ContainerDied","Data":"b598e615b996ee656b7ff582c460012b7da6048e4def9688e561842c75ad03f2"} Jul 22 13:47:00.046762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.046741 2556 scope.go:117] "RemoveContainer" containerID="b598e615b996ee656b7ff582c460012b7da6048e4def9688e561842c75ad03f2" Jul 22 13:47:00.048410 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.048368 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" event={"ID":"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e","Type":"ContainerStarted","Data":"588761924eada76dc9b697cc3196e6787bbcbda777f3d9f1ff14a00cc67e5ffe"} Jul 22 13:47:00.049987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.049966 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" event={"ID":"8ad905e1-ae67-4923-a0bc-9b22b5719667","Type":"ContainerStarted","Data":"3c2e834e0b55e537ea4b654bf9b0dee9a392ffc88eddbca3fbd36cf1e645ab37"} Jul 22 13:47:00.066970 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.066924 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-54q87" podStartSLOduration=26.751104491 podStartE2EDuration="46.06688896s" totalImagesPullingTime="19.315784469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.06044563 +0000 UTC m=+46.710461683" watchObservedRunningTime="2026-07-22 13:47:00.06688896 +0000 UTC m=+46.716905002" Jul 22 13:47:00.085319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.085267 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ctbz8" podStartSLOduration=32.486575982 podStartE2EDuration="42.085197852s" totalImagesPullingTime="9.59862187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.084873989 +0000 UTC m=+46.734890037" watchObservedRunningTime="2026-07-22 13:47:00.085197852 +0000 UTC m=+46.735213894" Jul 22 13:47:00.101322 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.101264 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5gk7m" podStartSLOduration=2.525384467 podStartE2EDuration="12.10124545s" totalImagesPullingTime="9.575860983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.10093004 +0000 UTC m=+46.750946075" watchObservedRunningTime="2026-07-22 13:47:00.10124545 +0000 UTC m=+46.751261471" Jul 22 13:47:00.118385 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.118327 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" podStartSLOduration=32.426812239 podStartE2EDuration="42.11830829s" totalImagesPullingTime="9.691496051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.117718499 +0000 UTC m=+46.767734539" watchObservedRunningTime="2026-07-22 13:47:00.11830829 +0000 UTC m=+46.768324311" Jul 22 13:47:00.161541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.161252 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" podStartSLOduration=32.457198769 podStartE2EDuration="42.161231516s" totalImagesPullingTime="9.704032747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.139182591 +0000 UTC m=+46.789198657" watchObservedRunningTime="2026-07-22 13:47:00.161231516 +0000 UTC m=+46.811247557" Jul 22 13:47:00.162490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.162017 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6d7cc" podStartSLOduration=32.582778667 podStartE2EDuration="42.162008831s" totalImagesPullingTime="9.579230164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.160148103 +0000 UTC m=+46.810164146" watchObservedRunningTime="2026-07-22 13:47:00.162008831 +0000 UTC m=+46.812024872" Jul 22 13:47:00.179293 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.179213 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" podStartSLOduration=32.547413916 podStartE2EDuration="42.179199602s" totalImagesPullingTime="9.631785686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:00.17851863 +0000 UTC m=+46.828534671" watchObservedRunningTime="2026-07-22 13:47:00.179199602 +0000 UTC m=+46.829215667" Jul 22 13:47:00.188814 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.188735 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:00.241574 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.241126 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r6mgz"] Jul 22 13:47:00.260241 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.255999 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.260241 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.258320 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6mgz"] Jul 22 13:47:00.260585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.260565 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lrzs\"" Jul 22 13:47:00.260821 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.260806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 13:47:00.261197 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.261094 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 13:47:00.270136 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.269830 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:00.280973 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.280659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9qq\" (UniqueName: \"kubernetes.io/projected/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-api-access-tg9qq\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.280973 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.280712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.280973 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.280739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.280973 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.280776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-data-volume\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.280973 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.280818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-crio-socket\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.325312 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.325290 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:00.381608 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.381576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9qq\" (UniqueName: \"kubernetes.io/projected/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-api-access-tg9qq\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.381772 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.381627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.381772 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.381655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.381772 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.381686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-data-volume\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.381772 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.381719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-crio-socket\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.381998 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.381777 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 13:47:00.381998 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.381793 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 13:47:00.381998 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.381842 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:00.881822403 +0000 UTC m=+47.531838433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : secret "insights-runtime-extractor-tls" not found Jul 22 13:47:00.381998 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.381861 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:00.881851538 +0000 UTC m=+47.531867559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : configmap "kube-rbac-proxy" not found Jul 22 13:47:00.382210 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.382087 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-crio-socket\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.382210 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.382144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-data-volume\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.390352 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.390327 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:00.392485 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.392468 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9qq\" (UniqueName: \"kubernetes.io/projected/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-api-access-tg9qq\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.808544 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.808507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:00.887277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.887241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.887277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.887283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:00.887512 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.887375 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 13:47:00.887512 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.887408 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 13:47:00.887512 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.887443 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:01.887424308 +0000 UTC m=+48.537440329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : configmap "kube-rbac-proxy" not found Jul 22 13:47:00.887512 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:00.887472 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:01.887454522 +0000 UTC m=+48.537470553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : secret "insights-runtime-extractor-tls" not found Jul 22 13:47:00.908423 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:00.908390 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:01.040510 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.040480 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:01.055902 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.055881 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:47:01.056359 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.056342 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/0.log" Jul 22 13:47:01.056425 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.056383 2556 generic.go:356] "Generic (PLEG): container finished" podID="27834fe5-3551-41aa-ac25-232842ea5c5d" containerID="d94136055b72b55ba5706b183ec80d46357e800f47d10ce49af855fab12dbec1" exitCode=255 Jul 22 13:47:01.056568 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.056541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" event={"ID":"27834fe5-3551-41aa-ac25-232842ea5c5d","Type":"ContainerDied","Data":"d94136055b72b55ba5706b183ec80d46357e800f47d10ce49af855fab12dbec1"} Jul 22 13:47:01.056642 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.056601 2556 scope.go:117] "RemoveContainer" containerID="b598e615b996ee656b7ff582c460012b7da6048e4def9688e561842c75ad03f2" Jul 22 13:47:01.056712 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.056698 2556 scope.go:117] "RemoveContainer" containerID="d94136055b72b55ba5706b183ec80d46357e800f47d10ce49af855fab12dbec1" Jul 22 13:47:01.056901 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:01.056882 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-w52s6_openshift-console-operator(27834fe5-3551-41aa-ac25-232842ea5c5d)\"" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" podUID="27834fe5-3551-41aa-ac25-232842ea5c5d" Jul 22 13:47:01.135161 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.135127 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:01.233880 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.233844 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:01.895720 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.895681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:01.895720 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:01.895722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:01.895979 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:01.895797 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 13:47:01.895979 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:01.895832 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 13:47:01.895979 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:01.895851 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:03.895837475 +0000 UTC m=+50.545853493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : configmap "kube-rbac-proxy" not found Jul 22 13:47:01.895979 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:01.895885 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:03.895871698 +0000 UTC m=+50.545887716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : secret "insights-runtime-extractor-tls" not found Jul 22 13:47:02.051233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:02.051208 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dwm5b_14e7623c-8bd6-4052-8c88-4c1e606c862a/dns-node-resolver/0.log" Jul 22 13:47:02.061824 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:02.061799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:47:02.062152 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:02.062131 2556 scope.go:117] "RemoveContainer" containerID="d94136055b72b55ba5706b183ec80d46357e800f47d10ce49af855fab12dbec1" Jul 22 13:47:02.062312 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:02.062294 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-w52s6_openshift-console-operator(27834fe5-3551-41aa-ac25-232842ea5c5d)\"" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" podUID="27834fe5-3551-41aa-ac25-232842ea5c5d" Jul 22 13:47:02.655121 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:02.655091 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vhjw_f83143e8-413e-4061-b544-0e23aa8d7808/node-ca/0.log" Jul 22 13:47:02.743511 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:02.743479 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:02.808091 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:02.808057 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:03.452277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:03.452248 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5gk7m_89c84897-b70f-4cda-a30c-4e2ca5393723/serve-healthcheck-canary/0.log" Jul 22 13:47:03.640593 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:03.640562 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:03.914585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:03.914547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:03.914585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:03.914588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:03.914800 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:03.914707 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 13:47:03.914800 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:03.914740 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 13:47:03.914800 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:03.914784 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:07.914760586 +0000 UTC m=+54.564776626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : secret "insights-runtime-extractor-tls" not found Jul 22 13:47:03.914800 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:03.914800 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:07.914793526 +0000 UTC m=+54.564809548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : configmap "kube-rbac-proxy" not found Jul 22 13:47:04.625967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.625900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:04.625967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.625974 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.626010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626094 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.626074525 +0000 UTC m=+67.276090544 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : configmap references non-existent config key: service-ca.crt Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626131 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626151 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626180 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs podName:05628bba-3c32-43e4-907e-f4edd8409f18 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.626167971 +0000 UTC m=+67.276183989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs") pod "router-default-5b4f55cfd4-s2c5b" (UID: "05628bba-3c32-43e4-907e-f4edd8409f18") : secret "router-metrics-certs-default" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626195 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls podName:89be1ea5-8869-470b-b2fa-99123acfac17 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.626188983 +0000 UTC m=+67.276205001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w4zdg" (UID: "89be1ea5-8869-470b-b2fa-99123acfac17") : secret "cluster-monitoring-operator-tls" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.626147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626212 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626259 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7854fd8576-rgm7n: secret "image-registry-tls" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.626277 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626295 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls podName:154d4f5b-7c7b-430d-8336-34e4702777a4 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.626282787 +0000 UTC m=+67.276298834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls") pod "image-registry-7854fd8576-rgm7n" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4") : secret "image-registry-tls" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626322 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 13:47:04.626467 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.626344 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls podName:1151eeb0-1205-408d-b7a6-1385f6fbde5b nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.626337686 +0000 UTC m=+67.276353704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-p798n" (UID: "1151eeb0-1205-408d-b7a6-1385f6fbde5b") : secret "samples-operator-tls" not found Jul 22 13:47:04.638488 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.638459 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:04.727585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.727555 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:47:04.727761 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:04.727613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:47:04.727761 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.727727 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 13:47:04.727761 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.727727 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 13:47:04.727930 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.727785 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert podName:67b45d8b-2f40-44ec-89dc-340c7789aa24 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.727769256 +0000 UTC m=+67.377785279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-279dc" (UID: "67b45d8b-2f40-44ec-89dc-340c7789aa24") : secret "networking-console-plugin-cert" not found Jul 22 13:47:04.727930 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:04.727800 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls podName:815af2ec-bb4e-420a-8d20-4606191d093b nodeName:}" failed. No retries permitted until 2026-07-22 13:47:20.72779312 +0000 UTC m=+67.377809139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls") pod "dns-default-bjxbr" (UID: "815af2ec-bb4e-420a-8d20-4606191d093b") : secret "dns-default-metrics-tls" not found Jul 22 13:47:05.445928 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:05.445885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:05.514296 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:05.514266 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:06.375547 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:06.375516 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:06.951678 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:06.951646 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:07.119964 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:07.119929 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:07.221448 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:07.221371 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:07.447177 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:07.447145 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:07.959018 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:07.958978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:07.959203 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:07.959033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:07.959203 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:07.959036 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 13:47:07.959203 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:07.959196 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls podName:3d8e35d8-b08e-4fbb-b285-cc438bf99b60 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:15.9591822 +0000 UTC m=+62.609198218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6mgz" (UID: "3d8e35d8-b08e-4fbb-b285-cc438bf99b60") : secret "insights-runtime-extractor-tls" not found Jul 22 13:47:07.959454 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:07.959435 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:08.895651 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:08.895617 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:08.997003 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:08.996970 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:09.147424 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:09.147337 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:47:09.147424 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:09.147424 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:47:09.147778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:09.147766 2556 scope.go:117] "RemoveContainer" containerID="d94136055b72b55ba5706b183ec80d46357e800f47d10ce49af855fab12dbec1" Jul 22 13:47:09.147952 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:09.147933 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-w52s6_openshift-console-operator(27834fe5-3551-41aa-ac25-232842ea5c5d)\"" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" podUID="27834fe5-3551-41aa-ac25-232842ea5c5d" Jul 22 13:47:09.448939 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:09.448835 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:09.637967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:09.637933 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:09.850010 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:09.849983 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:10.096994 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:10.096959 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:10.251672 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:10.251588 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:10.636050 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:10.636023 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:10.834334 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:10.834300 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:11.043039 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:11.042952 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:11.238282 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:11.238241 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:11.431785 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:11.431754 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:11.498162 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:11.498135 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:11.840390 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:11.840312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:12.642117 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:12.642088 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:12.742901 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:12.742869 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:12.844015 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:12.843984 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:13.028162 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:13.028083 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:13.232517 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:13.232481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:13.301795 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:13.301718 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:13.446466 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:13.446421 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:14.049160 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:14.049126 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:14.429199 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:14.429158 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:14.638661 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:14.638618 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:14.974922 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:14.974879 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2c6s" Jul 22 13:47:15.233543 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:15.233461 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:15.431152 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:15.431099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:16.031361 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.031322 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:16.033509 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.033488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:16.035742 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.035723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d8e35d8-b08e-4fbb-b285-cc438bf99b60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6mgz\" (UID: \"3d8e35d8-b08e-4fbb-b285-cc438bf99b60\") " pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:16.229965 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.229932 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lrzs\"" Jul 22 13:47:16.238844 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.238814 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6mgz" Jul 22 13:47:16.370554 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.370501 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6mgz"] Jul 22 13:47:16.376104 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:16.376069 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8e35d8_b08e_4fbb_b285_cc438bf99b60.slice/crio-e02bf2bb7ca31a54ed18e609b347e233f37b4ea895b1bc3651a8cbc72fa4d569 WatchSource:0}: Error finding container e02bf2bb7ca31a54ed18e609b347e233f37b4ea895b1bc3651a8cbc72fa4d569: Status 404 returned error can't find the container with id e02bf2bb7ca31a54ed18e609b347e233f37b4ea895b1bc3651a8cbc72fa4d569 Jul 22 13:47:16.434590 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.434553 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:16.835451 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:16.835410 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:17.041844 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:17.041762 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:17.111918 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:17.111836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6mgz" event={"ID":"3d8e35d8-b08e-4fbb-b285-cc438bf99b60","Type":"ContainerStarted","Data":"e02bf2bb7ca31a54ed18e609b347e233f37b4ea895b1bc3651a8cbc72fa4d569"} Jul 22 13:47:17.428827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:17.428696 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:17.636024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:17.635953 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:18.560147 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.560107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:47:18.560598 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.560291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:47:18.562303 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.562277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 13:47:18.562425 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.562277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 13:47:18.573655 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.573631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdb417f-ddd0-4369-82a7-ce3ac406a7ae-metrics-certs\") pod \"network-metrics-daemon-nwtfn\" (UID: \"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae\") " pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:47:18.573789 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.573704 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bce330f2-bfcc-4b90-ac12-e548ce40c0ba-original-pull-secret\") pod \"global-pull-secret-syncer-f8wgc\" (UID: \"bce330f2-bfcc-4b90-ac12-e548ce40c0ba\") " pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:47:18.578566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.578546 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phx9h\"" Jul 22 13:47:18.587445 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.587418 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nwtfn" Jul 22 13:47:18.660982 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.660946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:47:18.663660 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.663625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7hw\" (UniqueName: \"kubernetes.io/projected/27c8effe-0aa3-4148-a398-2400ed512c9c-kube-api-access-9f7hw\") pod \"network-check-target-kj49c\" (UID: \"27c8effe-0aa3-4148-a398-2400ed512c9c\") " pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:47:18.868944 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.868887 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8wgc" Jul 22 13:47:18.884124 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.884095 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6npf\"" Jul 22 13:47:18.892919 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:18.892892 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:47:19.816900 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:19.816775 2556 scope.go:117] "RemoveContainer" containerID="d94136055b72b55ba5706b183ec80d46357e800f47d10ce49af855fab12dbec1" Jul 22 13:47:20.448562 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.448525 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:20.526442 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.526388 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:20.682029 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.681982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:47:20.682159 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.682076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:47:20.682243 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.682162 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:20.682243 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.682191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:20.682243 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.682229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:47:20.682896 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.682872 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05628bba-3c32-43e4-907e-f4edd8409f18-service-ca-bundle\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:20.685463 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.685414 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1151eeb0-1205-408d-b7a6-1385f6fbde5b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-p798n\" (UID: \"1151eeb0-1205-408d-b7a6-1385f6fbde5b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:47:20.686382 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.686327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"image-registry-7854fd8576-rgm7n\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:47:20.687314 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.687257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05628bba-3c32-43e4-907e-f4edd8409f18-metrics-certs\") pod \"router-default-5b4f55cfd4-s2c5b\" (UID: \"05628bba-3c32-43e4-907e-f4edd8409f18\") " pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:20.687706 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.687626 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/89be1ea5-8869-470b-b2fa-99123acfac17-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w4zdg\" (UID: \"89be1ea5-8869-470b-b2fa-99123acfac17\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:47:20.767251 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.767217 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nwtfn"] Jul 22 13:47:20.783116 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.783076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:47:20.783289 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.783145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:47:20.786325 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.786295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/815af2ec-bb4e-420a-8d20-4606191d093b-metrics-tls\") pod \"dns-default-bjxbr\" (UID: \"815af2ec-bb4e-420a-8d20-4606191d093b\") " pod="openshift-dns/dns-default-bjxbr" Jul 22 13:47:20.786451 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.786430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/67b45d8b-2f40-44ec-89dc-340c7789aa24-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-279dc\" (UID: \"67b45d8b-2f40-44ec-89dc-340c7789aa24\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:47:20.877185 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.877142 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sqdjp\"" Jul 22 13:47:20.885183 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.885141 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:47:20.912743 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.912712 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6khfm\"" Jul 22 13:47:20.920597 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.920566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" Jul 22 13:47:20.921413 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.921391 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sqrn8\"" Jul 22 13:47:20.930082 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.930051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" Jul 22 13:47:20.933092 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.933066 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jv299\"" Jul 22 13:47:20.939472 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.939440 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5knn8\"" Jul 22 13:47:20.942156 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.942131 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:20.948366 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.948347 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" Jul 22 13:47:20.957683 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.957661 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vvhl\"" Jul 22 13:47:20.966438 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:20.966379 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bjxbr" Jul 22 13:47:21.036802 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:21.036771 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdb417f_ddd0_4369_82a7_ce3ac406a7ae.slice/crio-7178cd8b6c8a7c872ea3ad319eed6bccfa635ed1c0dcc16b465b026c2e987d32 WatchSource:0}: Error finding container 7178cd8b6c8a7c872ea3ad319eed6bccfa635ed1c0dcc16b465b026c2e987d32: Status 404 returned error can't find the container with id 7178cd8b6c8a7c872ea3ad319eed6bccfa635ed1c0dcc16b465b026c2e987d32 Jul 22 13:47:21.127530 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.127309 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nwtfn" event={"ID":"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae","Type":"ContainerStarted","Data":"7178cd8b6c8a7c872ea3ad319eed6bccfa635ed1c0dcc16b465b026c2e987d32"} Jul 22 13:47:21.166086 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.166054 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kj49c"] Jul 22 13:47:21.471053 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:21.471016 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c8effe_0aa3_4148_a398_2400ed512c9c.slice/crio-326028f8783fcc814518d5fe9ea9ad42aa99c988676d7bf8fa2e65c16c96a7e5 WatchSource:0}: Error finding container 326028f8783fcc814518d5fe9ea9ad42aa99c988676d7bf8fa2e65c16c96a7e5: Status 404 returned error can't find the container with id 326028f8783fcc814518d5fe9ea9ad42aa99c988676d7bf8fa2e65c16c96a7e5 Jul 22 13:47:21.599479 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.597007 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9"] Jul 22 13:47:21.620081 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.617011 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.621986 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.620430 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 13:47:21.621986 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.620936 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 22 13:47:21.626819 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.623070 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9"] Jul 22 13:47:21.626819 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.625892 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 13:47:21.631267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.631224 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 13:47:21.754118 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.753962 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:21.789681 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.789647 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f8wgc"] Jul 22 13:47:21.790652 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.790630 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg"] Jul 22 13:47:21.793604 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.793570 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7854fd8576-rgm7n"] Jul 22 13:47:21.797870 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.797834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a770579c-fba1-4f58-8a79-303f31946513-tmp\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.798062 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.798024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9kg9\" (UniqueName: \"kubernetes.io/projected/a770579c-fba1-4f58-8a79-303f31946513-kube-api-access-r9kg9\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.798062 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.798066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a770579c-fba1-4f58-8a79-303f31946513-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.821312 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.821271 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-279dc"] Jul 22 13:47:21.822760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.822738 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bjxbr"] Jul 22 13:47:21.839683 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.839647 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n"] Jul 22 13:47:21.843434 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.843412 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b4f55cfd4-s2c5b"] Jul 22 13:47:21.854631 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.854601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:21.899239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.899201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9kg9\" (UniqueName: \"kubernetes.io/projected/a770579c-fba1-4f58-8a79-303f31946513-kube-api-access-r9kg9\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.899239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.899250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a770579c-fba1-4f58-8a79-303f31946513-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.899771 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.899288 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a770579c-fba1-4f58-8a79-303f31946513-tmp\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.899771 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.899707 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a770579c-fba1-4f58-8a79-303f31946513-tmp\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.902258 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.902226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a770579c-fba1-4f58-8a79-303f31946513-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.912221 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.911831 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9kg9\" (UniqueName: \"kubernetes.io/projected/a770579c-fba1-4f58-8a79-303f31946513-kube-api-access-r9kg9\") pod \"klusterlet-addon-workmgr-7b54d7b749-8qst9\" (UID: \"a770579c-fba1-4f58-8a79-303f31946513\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:21.917760 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:21.917708 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815af2ec_bb4e_420a_8d20_4606191d093b.slice/crio-1bc948db6a636ef8fca68e578b5d410c1ea5d8a749d3689632798fa3cc367a40 WatchSource:0}: Error finding container 1bc948db6a636ef8fca68e578b5d410c1ea5d8a749d3689632798fa3cc367a40: Status 404 returned error can't find the container with id 1bc948db6a636ef8fca68e578b5d410c1ea5d8a749d3689632798fa3cc367a40 Jul 22 13:47:21.918119 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:21.918083 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05628bba_3c32_43e4_907e_f4edd8409f18.slice/crio-71e6fcc832eea300d9e2ec25708d603ecb4bd933c1416d9c5ccf1343efbb18d6 WatchSource:0}: Error finding container 71e6fcc832eea300d9e2ec25708d603ecb4bd933c1416d9c5ccf1343efbb18d6: Status 404 returned error can't find the container with id 71e6fcc832eea300d9e2ec25708d603ecb4bd933c1416d9c5ccf1343efbb18d6 Jul 22 13:47:21.955009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.954929 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:21.972329 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:21.972228 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:22.058006 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.057979 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:22.139549 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.139427 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:47:22.139713 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.139556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" event={"ID":"27834fe5-3551-41aa-ac25-232842ea5c5d","Type":"ContainerStarted","Data":"25bd73ee1baecadc125b664f71ab2ceaddddcb65d63084a85d6e2b5648074e32"} Jul 22 13:47:22.140366 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.140340 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:47:22.143036 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.142918 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" event={"ID":"67b45d8b-2f40-44ec-89dc-340c7789aa24","Type":"ContainerStarted","Data":"c4f4f5203ff9e36ba6b05931b9e4c3b3073ebaff584011087d3dfba0644b620e"} Jul 22 13:47:22.146265 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.146138 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" event={"ID":"05628bba-3c32-43e4-907e-f4edd8409f18","Type":"ContainerStarted","Data":"0197b47dc283fdcff280ebea068ced5f110cda125fad91d589310b6943810f84"} Jul 22 13:47:22.146265 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.146176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" event={"ID":"05628bba-3c32-43e4-907e-f4edd8409f18","Type":"ContainerStarted","Data":"71e6fcc832eea300d9e2ec25708d603ecb4bd933c1416d9c5ccf1343efbb18d6"} Jul 22 13:47:22.147774 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.147750 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" event={"ID":"1151eeb0-1205-408d-b7a6-1385f6fbde5b","Type":"ContainerStarted","Data":"78a8583c843cee88ac17eed59a662c3a94b76dd50b8d94ca2eb58281f514f41c"} Jul 22 13:47:22.149284 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.149253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" event={"ID":"89be1ea5-8869-470b-b2fa-99123acfac17","Type":"ContainerStarted","Data":"e08ce99bffaf26bc32a3814feaa220bb1e685ce5e75b51704d2b9225b0703482"} Jul 22 13:47:22.151123 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.151076 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" event={"ID":"154d4f5b-7c7b-430d-8336-34e4702777a4","Type":"ContainerStarted","Data":"66d80fe8da6fe0cdeae287e041acfc648d7d505778b07734c28c67eabd8ffb4c"} Jul 22 13:47:22.151123 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.151114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" event={"ID":"154d4f5b-7c7b-430d-8336-34e4702777a4","Type":"ContainerStarted","Data":"57fa21e6f4622b80a11faed64c65d3fb6deb5f60801c1c92d5a9c00795c3fc9b"} Jul 22 13:47:22.151264 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.151250 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:47:22.153020 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.152996 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kj49c" event={"ID":"27c8effe-0aa3-4148-a398-2400ed512c9c","Type":"ContainerStarted","Data":"8bccb38b920598c6f8bef4b3537a24b23d886b5c6deca6a3c46b0e790bf70cc0"} Jul 22 13:47:22.153192 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.153143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kj49c" event={"ID":"27c8effe-0aa3-4148-a398-2400ed512c9c","Type":"ContainerStarted","Data":"326028f8783fcc814518d5fe9ea9ad42aa99c988676d7bf8fa2e65c16c96a7e5"} Jul 22 13:47:22.153760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.153741 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:47:22.155741 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.155719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6mgz" event={"ID":"3d8e35d8-b08e-4fbb-b285-cc438bf99b60","Type":"ContainerStarted","Data":"de557a74843edf62cbe1fe6a7ad6c64c79c3ffcdab0c6de44dc80ab30088e5e7"} Jul 22 13:47:22.156974 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.156954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bjxbr" event={"ID":"815af2ec-bb4e-420a-8d20-4606191d093b","Type":"ContainerStarted","Data":"1bc948db6a636ef8fca68e578b5d410c1ea5d8a749d3689632798fa3cc367a40"} Jul 22 13:47:22.158951 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.158894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f8wgc" event={"ID":"bce330f2-bfcc-4b90-ac12-e548ce40c0ba","Type":"ContainerStarted","Data":"dd526020f7de91559da9adfcd6c48fa4bc69c05d5bb2842907925031c6c6832d"} Jul 22 13:47:22.159229 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.159197 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" podStartSLOduration=54.586868252 podStartE2EDuration="1m4.159185435s" totalImagesPullingTime="9.572317183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:22.158472345 +0000 UTC m=+68.808488386" watchObservedRunningTime="2026-07-22 13:47:22.159185435 +0000 UTC m=+68.809201475" Jul 22 13:47:22.176538 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.176480 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kj49c" podStartSLOduration=68.176461931 podStartE2EDuration="1m8.176461931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:22.175979244 +0000 UTC m=+68.825995285" watchObservedRunningTime="2026-07-22 13:47:22.176461931 +0000 UTC m=+68.826477971" Jul 22 13:47:22.179043 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.179018 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9"] Jul 22 13:47:22.183375 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:22.183348 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda770579c_fba1_4f58_8a79_303f31946513.slice/crio-76c99e505c46ea5933c0f85011766fa70f889714df51d38b623c17283f280254 WatchSource:0}: Error finding container 76c99e505c46ea5933c0f85011766fa70f889714df51d38b623c17283f280254: Status 404 returned error can't find the container with id 76c99e505c46ea5933c0f85011766fa70f889714df51d38b623c17283f280254 Jul 22 13:47:22.198451 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.198401 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" podStartSLOduration=67.198381442 podStartE2EDuration="1m7.198381442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:22.196537249 +0000 UTC m=+68.846553302" watchObservedRunningTime="2026-07-22 13:47:22.198381442 +0000 UTC m=+68.848397483" Jul 22 13:47:22.218139 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.217803 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" podStartSLOduration=64.217780254 podStartE2EDuration="1m4.217780254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:22.217018509 +0000 UTC m=+68.867034550" watchObservedRunningTime="2026-07-22 13:47:22.217780254 +0000 UTC m=+68.867796275" Jul 22 13:47:22.470617 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.470587 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-w52s6" Jul 22 13:47:22.689183 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.688963 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:22.756276 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.756194 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:22.854659 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.854585 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:22.942708 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.942636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:22.945980 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.945771 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:22.953518 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:22.953460 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.142730 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.142695 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.167723 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.167062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nwtfn" event={"ID":"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae","Type":"ContainerStarted","Data":"c054268b05e861453c5c2cb0ce8ed0c5e0157f92f77b545b36bb8d308eda2aa6"} Jul 22 13:47:23.167723 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.167162 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nwtfn" event={"ID":"ccdb417f-ddd0-4369-82a7-ce3ac406a7ae","Type":"ContainerStarted","Data":"32a931200cb4de689e1942f478540c8c446a08748b743472c14c666722c4b0f9"} Jul 22 13:47:23.171038 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.170998 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" event={"ID":"a770579c-fba1-4f58-8a79-303f31946513","Type":"ContainerStarted","Data":"76c99e505c46ea5933c0f85011766fa70f889714df51d38b623c17283f280254"} Jul 22 13:47:23.171523 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.171502 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:23.173589 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.173548 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b4f55cfd4-s2c5b" Jul 22 13:47:23.184527 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.183888 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nwtfn" podStartSLOduration=67.659494057 podStartE2EDuration="1m9.183868611s" totalImagesPullingTime="1.524374554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:23.182504954 +0000 UTC m=+69.832521014" watchObservedRunningTime="2026-07-22 13:47:23.183868611 +0000 UTC m=+69.833884653" Jul 22 13:47:23.290952 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.290898 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.388415 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.388318 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.546473 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.546367 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.649945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.649848 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.750482 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.750410 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:23.851042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:23.850922 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:24.394874 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:24.394777 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:24.553597 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:24.553559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:25.089893 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:25.089808 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:25.768768 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:25.768726 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:25.869679 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:25.869633 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:26.721430 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:26.721387 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:26.777101 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:26.777068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:28.966706 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:28.966671 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:29.066727 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:29.066612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:30.208670 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.208583 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bjxbr" event={"ID":"815af2ec-bb4e-420a-8d20-4606191d093b","Type":"ContainerStarted","Data":"72aedb9766fd45592bce034f84d503590146b5f4a8c934d0be50a8429ca858ec"} Jul 22 13:47:30.210989 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.210961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" event={"ID":"67b45d8b-2f40-44ec-89dc-340c7789aa24","Type":"ContainerStarted","Data":"ec857c40943525ba7f2339a71756d78d3e9c850b5dc6e2c1aac30d8b9e8849ed"} Jul 22 13:47:30.213016 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.212990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" event={"ID":"1151eeb0-1205-408d-b7a6-1385f6fbde5b","Type":"ContainerStarted","Data":"5d3199597ea0e4978bac92bc39d82be4839d968dbdb58e0cd8a9ce07213bf178"} Jul 22 13:47:30.213117 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.213039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" event={"ID":"1151eeb0-1205-408d-b7a6-1385f6fbde5b","Type":"ContainerStarted","Data":"943d3d6c22e8da752eea8b4e64ed7636d37b2bcfc114ee2851bb7aacb163ea5f"} Jul 22 13:47:30.215011 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.214989 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" event={"ID":"89be1ea5-8869-470b-b2fa-99123acfac17","Type":"ContainerStarted","Data":"c2b1b978d359d153f5e3f00f8ae0f0b0238a501230b6d4748857a5d92c546f4d"} Jul 22 13:47:30.216376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.216343 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f8wgc" event={"ID":"bce330f2-bfcc-4b90-ac12-e548ce40c0ba","Type":"ContainerStarted","Data":"e7d3a37bf03785a43e198438eccdc526d53452fb9625a2364f9fff5affa6174c"} Jul 22 13:47:30.255744 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.255668 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-p798n" podStartSLOduration=64.421474633 podStartE2EDuration="1m12.255649545s" totalImagesPullingTime="7.834174912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:30.253966064 +0000 UTC m=+76.903982105" watchObservedRunningTime="2026-07-22 13:47:30.255649545 +0000 UTC m=+76.905665590" Jul 22 13:47:30.274580 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.274525 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w4zdg" podStartSLOduration=64.345194879 podStartE2EDuration="1m12.274504456s" totalImagesPullingTime="7.929309577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:30.273517849 +0000 UTC m=+76.923533891" watchObservedRunningTime="2026-07-22 13:47:30.274504456 +0000 UTC m=+76.924520497" Jul 22 13:47:30.296288 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.296243 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f8wgc" podStartSLOduration=67.399987763 podStartE2EDuration="1m15.296226338s" totalImagesPullingTime="7.896238575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:30.295697683 +0000 UTC m=+76.945713745" watchObservedRunningTime="2026-07-22 13:47:30.296226338 +0000 UTC m=+76.946242377" Jul 22 13:47:30.316300 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:30.316251 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-279dc" podStartSLOduration=48.601126561 podStartE2EDuration="51.316234024s" totalImagesPullingTime="2.715107463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:30.31568006 +0000 UTC m=+76.965696102" watchObservedRunningTime="2026-07-22 13:47:30.316234024 +0000 UTC m=+76.966250063" Jul 22 13:47:31.159854 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:31.159795 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:31.223623 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:31.223584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6mgz" event={"ID":"3d8e35d8-b08e-4fbb-b285-cc438bf99b60","Type":"ContainerStarted","Data":"efc0387395a9b30d939351a8fd1bd9caeafaf27b385f84f247f5849ddc8a3021"} Jul 22 13:47:31.225843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:31.225805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bjxbr" event={"ID":"815af2ec-bb4e-420a-8d20-4606191d093b","Type":"ContainerStarted","Data":"042b2d2f2562a4327350ee3e73a873f3d63470d7095c3b2e4153b8575f45d195"} Jul 22 13:47:31.226612 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:31.226588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bjxbr" Jul 22 13:47:31.248650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:31.248586 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bjxbr" podStartSLOduration=35.352920109 podStartE2EDuration="43.248525358s" totalImagesPullingTime="7.895605249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:31.247888967 +0000 UTC m=+77.897905007" watchObservedRunningTime="2026-07-22 13:47:31.248525358 +0000 UTC m=+77.898541399" Jul 22 13:47:31.268511 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:31.268436 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:35.488446 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:35.488320 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:35.563389 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:35.563356 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:35.891510 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:35.891480 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:37.252302 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.252262 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6mgz" event={"ID":"3d8e35d8-b08e-4fbb-b285-cc438bf99b60","Type":"ContainerStarted","Data":"373ddafd0c115053aa9ddc3204f1a8f7ed223a93d61174f0bf02568d5a47aea2"} Jul 22 13:47:37.253724 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.253697 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" event={"ID":"a770579c-fba1-4f58-8a79-303f31946513","Type":"ContainerStarted","Data":"d74de0612aea6e0634e9c2a17be0691f7e1e6e2c1996edc3d5ad74f10b8a7141"} Jul 22 13:47:37.253937 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.253923 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:37.255568 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.255550 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" Jul 22 13:47:37.270371 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.270332 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r6mgz" podStartSLOduration=17.726313897 podStartE2EDuration="37.270319769s" totalImagesPullingTime="19.544005872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:47:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:37.268989067 +0000 UTC m=+83.919005105" watchObservedRunningTime="2026-07-22 13:47:37.270319769 +0000 UTC m=+83.920335809" Jul 22 13:47:37.284219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.284168 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b54d7b749-8qst9" podStartSLOduration=2.258938278 podStartE2EDuration="16.28415211s" totalImagesPullingTime="14.025213832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:37.283424538 +0000 UTC m=+83.933440589" watchObservedRunningTime="2026-07-22 13:47:37.28415211 +0000 UTC m=+83.934168151" Jul 22 13:47:37.387161 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.387130 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:37.444047 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:37.444014 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:40.890336 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:40.890298 2556 patch_prober.go:28] interesting pod/image-registry-7854fd8576-rgm7n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 13:47:40.890710 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:40.890357 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" podUID="154d4f5b-7c7b-430d-8336-34e4702777a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 13:47:41.170111 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:41.170035 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:42.237181 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:42.237152 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bjxbr" Jul 22 13:47:43.175734 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.175709 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:47:43.444497 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.444415 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:43.507095 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.507060 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:43.598365 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.598333 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7854fd8576-rgm7n"] Jul 22 13:47:43.679429 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.679397 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:43.740572 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.740501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:43.835490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.835461 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:43.894310 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:43.894281 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:48.791079 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:48.791045 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:48.858822 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:48.858791 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:49.419308 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:49.419275 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:49.481163 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:49.481134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:50.450578 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:50.450542 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:50.503233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:50.503206 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:51.123836 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:51.123804 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:51.784259 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:51.784225 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:51.884695 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:51.884666 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.122148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.122111 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.223611 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.223580 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.322849 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.322813 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.423953 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.423851 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.525485 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.525454 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.627650 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.627620 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:53.699380 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:53.699311 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:54.179944 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.179894 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kj49c" Jul 22 13:47:54.620308 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.620276 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:54.840396 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.840361 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:54.894278 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.894196 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ss4hh"] Jul 22 13:47:54.913800 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.913769 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:54.915000 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.914984 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.917121 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.917094 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 13:47:54.917382 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.917318 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 13:47:54.917488 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.917448 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cmg6q\"" Jul 22 13:47:54.917545 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.917486 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 13:47:54.917545 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.917490 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 13:47:54.935865 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.935842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-metrics-client-ca\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.935983 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.935873 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdqp\" (UniqueName: \"kubernetes.io/projected/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-kube-api-access-vxdqp\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.935983 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.935891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-sys\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.935983 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.935927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-wtmp\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.935983 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.935982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-tls\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.936140 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.936010 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-textfile\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.936140 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.936037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-root\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.936140 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.936061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:54.936140 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:54.936086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037246 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-wtmp\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-tls\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-textfile\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-root\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:55.037378 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037393 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-wtmp\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037452 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-root\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:47:55.037460 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-tls podName:cca3098c-2ff7-4bf2-9b19-289bbdbf0166 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:55.537438097 +0000 UTC m=+102.187454115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-tls") pod "node-exporter-ss4hh" (UID: "cca3098c-2ff7-4bf2-9b19-289bbdbf0166") : secret "node-exporter-tls" not found Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037498 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-metrics-client-ca\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdqp\" (UniqueName: \"kubernetes.io/projected/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-kube-api-access-vxdqp\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-sys\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-sys\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.037753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-textfile\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.038070 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.037976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.038219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.038202 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-metrics-client-ca\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.039690 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.039676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.045799 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.045781 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdqp\" (UniqueName: \"kubernetes.io/projected/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-kube-api-access-vxdqp\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.128171 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.128134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:55.228690 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.228610 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:55.333532 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.333499 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:55.427130 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.427092 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:55.542339 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.542243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-tls\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.544533 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.544510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cca3098c-2ff7-4bf2-9b19-289bbdbf0166-node-exporter-tls\") pod \"node-exporter-ss4hh\" (UID: \"cca3098c-2ff7-4bf2-9b19-289bbdbf0166\") " pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.610011 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.609982 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:55.824275 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.824205 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss4hh" Jul 22 13:47:55.836787 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:47:55.836757 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca3098c_2ff7_4bf2_9b19_289bbdbf0166.slice/crio-3197bec4ba3ce3ce2ffef6f98fe45ac5d0d47ab19f1b3bd4f0f163b7f8bc135c WatchSource:0}: Error finding container 3197bec4ba3ce3ce2ffef6f98fe45ac5d0d47ab19f1b3bd4f0f163b7f8bc135c: Status 404 returned error can't find the container with id 3197bec4ba3ce3ce2ffef6f98fe45ac5d0d47ab19f1b3bd4f0f163b7f8bc135c Jul 22 13:47:55.891766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:55.891734 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:56.075688 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:56.075597 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:56.219936 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:56.219891 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:56.322206 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:56.322174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4hh" event={"ID":"cca3098c-2ff7-4bf2-9b19-289bbdbf0166","Type":"ContainerStarted","Data":"3197bec4ba3ce3ce2ffef6f98fe45ac5d0d47ab19f1b3bd4f0f163b7f8bc135c"} Jul 22 13:47:57.327992 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:57.327841 2556 generic.go:356] "Generic (PLEG): container finished" podID="cca3098c-2ff7-4bf2-9b19-289bbdbf0166" containerID="11c2cacc61089cbf60106ff44bd8d883626648c34d0f30e0dd0ef45ee214ed78" exitCode=0 Jul 22 13:47:57.327992 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:57.327943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4hh" event={"ID":"cca3098c-2ff7-4bf2-9b19-289bbdbf0166","Type":"ContainerDied","Data":"11c2cacc61089cbf60106ff44bd8d883626648c34d0f30e0dd0ef45ee214ed78"} Jul 22 13:47:57.818491 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:57.818460 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:57.899328 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:57.899294 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:58.013824 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.013793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:58.181021 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.180986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:58.333680 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.333647 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4hh" event={"ID":"cca3098c-2ff7-4bf2-9b19-289bbdbf0166","Type":"ContainerStarted","Data":"c44bd8f6b68a56db0c09def0998c322121acf928b5e65942b468f2fa4b762983"} Jul 22 13:47:58.334174 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.333701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss4hh" event={"ID":"cca3098c-2ff7-4bf2-9b19-289bbdbf0166","Type":"ContainerStarted","Data":"87d4f17b0bc92fafed8c8c5bffd653d9124d2d5d132237eee764600bc648fd9e"} Jul 22 13:47:58.356007 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.355956 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ss4hh" podStartSLOduration=3.268261507 podStartE2EDuration="4.355939248s" totalImagesPullingTime="1.02317094s" totalInitContainerRuntime="64.506801ms" isStatefulPod=true podCreationTimestamp="2026-07-22 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:58.354322849 +0000 UTC m=+105.004338890" watchObservedRunningTime="2026-07-22 13:47:58.355939248 +0000 UTC m=+105.005955289" Jul 22 13:47:58.430457 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.430420 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:58.532410 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:58.532336 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:59.691111 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:59.691068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:59.815304 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:59.815273 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:47:59.912231 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:47:59.912203 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:01.148653 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:01.148627 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:02.415538 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:02.415510 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:02.484276 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:02.484245 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:05.452264 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:05.452220 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:05.508945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:05.508904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:08.618090 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:08.618032 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" podUID="154d4f5b-7c7b-430d-8336-34e4702777a4" containerName="registry" containerID="cri-o://66d80fe8da6fe0cdeae287e041acfc648d7d505778b07734c28c67eabd8ffb4c" gracePeriod=30 Jul 22 13:48:09.373064 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.373036 2556 generic.go:356] "Generic (PLEG): container finished" podID="154d4f5b-7c7b-430d-8336-34e4702777a4" containerID="66d80fe8da6fe0cdeae287e041acfc648d7d505778b07734c28c67eabd8ffb4c" exitCode=0 Jul 22 13:48:09.373180 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.373108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" event={"ID":"154d4f5b-7c7b-430d-8336-34e4702777a4","Type":"ContainerDied","Data":"66d80fe8da6fe0cdeae287e041acfc648d7d505778b07734c28c67eabd8ffb4c"} Jul 22 13:48:09.373180 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.373155 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" event={"ID":"154d4f5b-7c7b-430d-8336-34e4702777a4","Type":"ContainerDied","Data":"57fa21e6f4622b80a11faed64c65d3fb6deb5f60801c1c92d5a9c00795c3fc9b"} Jul 22 13:48:09.373180 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.373171 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57fa21e6f4622b80a11faed64c65d3fb6deb5f60801c1c92d5a9c00795c3fc9b" Jul 22 13:48:09.391531 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.391512 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:48:09.448985 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.448960 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449005 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-image-registry-private-configuration\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449034 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-trusted-ca\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449057 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-certificates\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449330 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449142 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-installation-pull-secrets\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449330 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449195 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-bound-sa-token\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449330 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/154d4f5b-7c7b-430d-8336-34e4702777a4-ca-trust-extracted\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449330 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449309 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm6zx\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-kube-api-access-xm6zx\") pod \"154d4f5b-7c7b-430d-8336-34e4702777a4\" (UID: \"154d4f5b-7c7b-430d-8336-34e4702777a4\") " Jul 22 13:48:09.449537 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449455 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:48:09.449537 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449466 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:48:09.449653 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.449635 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-trusted-ca\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.451583 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.451551 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:48:09.451693 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.451605 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-kube-api-access-xm6zx" (OuterVolumeSpecName: "kube-api-access-xm6zx") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "kube-api-access-xm6zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:48:09.451747 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.451688 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:48:09.451833 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.451815 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:48:09.451942 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.451897 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:48:09.458518 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.458486 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/154d4f5b-7c7b-430d-8336-34e4702777a4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "154d4f5b-7c7b-430d-8336-34e4702777a4" (UID: "154d4f5b-7c7b-430d-8336-34e4702777a4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550617 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm6zx\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-kube-api-access-xm6zx\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550643 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-tls\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550653 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-image-registry-private-configuration\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550663 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/154d4f5b-7c7b-430d-8336-34e4702777a4-registry-certificates\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550671 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/154d4f5b-7c7b-430d-8336-34e4702777a4-installation-pull-secrets\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550679 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/154d4f5b-7c7b-430d-8336-34e4702777a4-bound-sa-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:09.550682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:09.550687 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/154d4f5b-7c7b-430d-8336-34e4702777a4-ca-trust-extracted\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:48:10.377707 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.377677 2556 generic.go:356] "Generic (PLEG): container finished" podID="7eac1bf2-f413-4b2f-bf4e-e3018de6fa12" containerID="755ca5d06d5eff4dd9385c32e834f65598144e0333aaff88fd04d7bb9bb374ef" exitCode=0 Jul 22 13:48:10.378187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.377760 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" event={"ID":"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12","Type":"ContainerDied","Data":"755ca5d06d5eff4dd9385c32e834f65598144e0333aaff88fd04d7bb9bb374ef"} Jul 22 13:48:10.378187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.377805 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7854fd8576-rgm7n" Jul 22 13:48:10.378298 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.378267 2556 scope.go:117] "RemoveContainer" containerID="755ca5d06d5eff4dd9385c32e834f65598144e0333aaff88fd04d7bb9bb374ef" Jul 22 13:48:10.396766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.396745 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7854fd8576-rgm7n"] Jul 22 13:48:10.400834 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.400814 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7854fd8576-rgm7n"] Jul 22 13:48:10.776332 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.776255 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:10.878393 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.878359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:10.976989 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:10.976953 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:11.382826 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:11.382792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-f6z4g" event={"ID":"7eac1bf2-f413-4b2f-bf4e-e3018de6fa12","Type":"ContainerStarted","Data":"c23242e772692c8a103b62b12a26b4b162372026525f0232729924475197347c"} Jul 22 13:48:11.448383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:11.448356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4f55cfd4-s2c5b_05628bba-3c32-43e4-907e-f4edd8409f18/router/0.log" Jul 22 13:48:11.457793 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:11.457760 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5gk7m_89c84897-b70f-4cda-a30c-4e2ca5393723/serve-healthcheck-canary/0.log" Jul 22 13:48:11.821002 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:11.820898 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="154d4f5b-7c7b-430d-8336-34e4702777a4" path="/var/lib/kubelet/pods/154d4f5b-7c7b-430d-8336-34e4702777a4/volumes" Jul 22 13:48:20.449559 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:20.449526 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:20.502004 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:20.501973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:25.440865 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:25.440830 2556 generic.go:356] "Generic (PLEG): container finished" podID="640ef9f2-2838-45f8-baf1-c25fc2c0dc6e" containerID="588761924eada76dc9b697cc3196e6787bbcbda777f3d9f1ff14a00cc67e5ffe" exitCode=0 Jul 22 13:48:25.441267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:25.440873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" event={"ID":"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e","Type":"ContainerDied","Data":"588761924eada76dc9b697cc3196e6787bbcbda777f3d9f1ff14a00cc67e5ffe"} Jul 22 13:48:25.441267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:25.441182 2556 scope.go:117] "RemoveContainer" containerID="588761924eada76dc9b697cc3196e6787bbcbda777f3d9f1ff14a00cc67e5ffe" Jul 22 13:48:26.446714 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:26.446676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xd8xj" event={"ID":"640ef9f2-2838-45f8-baf1-c25fc2c0dc6e","Type":"ContainerStarted","Data":"6f75bc9c9bc2849a503c3446acc9d573f05a7b75475f54a6ef4fe009408eb5cc"} Jul 22 13:48:26.448137 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:26.448114 2556 generic.go:356] "Generic (PLEG): container finished" podID="8ad905e1-ae67-4923-a0bc-9b22b5719667" containerID="3c2e834e0b55e537ea4b654bf9b0dee9a392ffc88eddbca3fbd36cf1e645ab37" exitCode=0 Jul 22 13:48:26.448246 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:26.448154 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" event={"ID":"8ad905e1-ae67-4923-a0bc-9b22b5719667","Type":"ContainerDied","Data":"3c2e834e0b55e537ea4b654bf9b0dee9a392ffc88eddbca3fbd36cf1e645ab37"} Jul 22 13:48:26.448421 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:26.448409 2556 scope.go:117] "RemoveContainer" containerID="3c2e834e0b55e537ea4b654bf9b0dee9a392ffc88eddbca3fbd36cf1e645ab37" Jul 22 13:48:27.456492 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:27.456459 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rg9gh" event={"ID":"8ad905e1-ae67-4923-a0bc-9b22b5719667","Type":"ContainerStarted","Data":"e941538c51628a9ca2bb07760316554796cbedde4342e44ad5558c16ff028b38"} Jul 22 13:48:27.493443 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:27.493410 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:27.593420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:27.593381 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:27.663982 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:27.663946 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:48:35.136410 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:48:35.136377 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:14.993074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:14.992985 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:15.073694 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:15.073659 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:19.236183 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.236141 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cb775b649-l48lf"] Jul 22 13:49:19.236577 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.236470 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="154d4f5b-7c7b-430d-8336-34e4702777a4" containerName="registry" Jul 22 13:49:19.236577 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.236482 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="154d4f5b-7c7b-430d-8336-34e4702777a4" containerName="registry" Jul 22 13:49:19.236577 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.236547 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="154d4f5b-7c7b-430d-8336-34e4702777a4" containerName="registry" Jul 22 13:49:19.239870 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.239846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.242451 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.242420 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 13:49:19.242571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.242481 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dmwxs\"" Jul 22 13:49:19.242571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.242495 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 13:49:19.242571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.242541 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 13:49:19.242821 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.242802 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 13:49:19.242899 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.242806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 13:49:19.249491 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.249471 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 13:49:19.255090 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.255071 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cb775b649-l48lf"] Jul 22 13:49:19.274904 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.274878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-telemeter-client-tls\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.274959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.274993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-serving-certs-ca-bundle\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.275012 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-metrics-client-ca\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275122 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.275029 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-federate-client-tls\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275122 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.275050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275122 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.275086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6hm2\" (UniqueName: \"kubernetes.io/projected/1a23f334-41d3-4993-b89e-0c9c35387abe-kube-api-access-k6hm2\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.275211 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.275124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-secret-telemeter-client\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-serving-certs-ca-bundle\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-metrics-client-ca\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375527 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-federate-client-tls\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6hm2\" (UniqueName: \"kubernetes.io/projected/1a23f334-41d3-4993-b89e-0c9c35387abe-kube-api-access-k6hm2\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375606 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-secret-telemeter-client\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.375745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.375672 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-telemeter-client-tls\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.376344 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.376315 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-serving-certs-ca-bundle\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.376502 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.376427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.376789 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.376768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a23f334-41d3-4993-b89e-0c9c35387abe-metrics-client-ca\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.378211 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.378185 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.378370 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.378347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-telemeter-client-tls\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.378505 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.378487 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-federate-client-tls\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.378559 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.378509 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1a23f334-41d3-4993-b89e-0c9c35387abe-secret-telemeter-client\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.385394 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.385362 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6hm2\" (UniqueName: \"kubernetes.io/projected/1a23f334-41d3-4993-b89e-0c9c35387abe-kube-api-access-k6hm2\") pod \"telemeter-client-7cb775b649-l48lf\" (UID: \"1a23f334-41d3-4993-b89e-0c9c35387abe\") " pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.550108 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.550023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" Jul 22 13:49:19.685368 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:19.685339 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cb775b649-l48lf"] Jul 22 13:49:19.688561 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:49:19.688534 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a23f334_41d3_4993_b89e_0c9c35387abe.slice/crio-45371aaf0dc605abbbe1fc5d33516c3091df5c683ef484156cb4c179a17861fe WatchSource:0}: Error finding container 45371aaf0dc605abbbe1fc5d33516c3091df5c683ef484156cb4c179a17861fe: Status 404 returned error can't find the container with id 45371aaf0dc605abbbe1fc5d33516c3091df5c683ef484156cb4c179a17861fe Jul 22 13:49:20.642281 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:20.642241 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" event={"ID":"1a23f334-41d3-4993-b89e-0c9c35387abe","Type":"ContainerStarted","Data":"45371aaf0dc605abbbe1fc5d33516c3091df5c683ef484156cb4c179a17861fe"} Jul 22 13:49:21.647420 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:21.647385 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" event={"ID":"1a23f334-41d3-4993-b89e-0c9c35387abe","Type":"ContainerStarted","Data":"e3024f2d97b96ad990b5c667512d2c6babdff8d59ee5f3a5447ff7dda28c405b"} Jul 22 13:49:23.656374 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:23.656339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" event={"ID":"1a23f334-41d3-4993-b89e-0c9c35387abe","Type":"ContainerStarted","Data":"41f95983a5aba9237601ff874409ab402d90a672e3a3bf240aff91d8ddbc2e92"} Jul 22 13:49:23.656727 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:23.656402 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" event={"ID":"1a23f334-41d3-4993-b89e-0c9c35387abe","Type":"ContainerStarted","Data":"1ad9a8daa2be62ffb0c9486d77b4a9c636b02be9533c20630205255df5120ac3"} Jul 22 13:49:23.680459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:23.680407 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cb775b649-l48lf" podStartSLOduration=0.985092491 podStartE2EDuration="4.680392159s" totalImagesPullingTime="3.695299668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:49:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:49:23.679314376 +0000 UTC m=+190.329330433" watchObservedRunningTime="2026-07-22 13:49:23.680392159 +0000 UTC m=+190.330408198" Jul 22 13:49:24.523234 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:24.523204 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:24.622903 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:24.622872 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:24.679745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:24.679721 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:25.206776 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:25.206743 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:25.284724 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:25.284694 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:35.164476 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:35.164441 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:35.265995 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:35.265963 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:35.746431 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:35.746396 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:41.487698 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:41.487666 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:41.549396 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:41.549366 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:49:51.729844 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:49:51.729805 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:29.398984 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:29.398951 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:29.467379 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:29.467328 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:30.401342 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:30.401308 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:41.427325 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:41.427225 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:41.487966 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:41.487934 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:50.455672 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:50.455634 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:52.084943 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:52.084879 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:56.834327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:56.834276 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:50:58.090080 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:50:58.090043 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:07.559780 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:07.559744 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:07.659633 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:07.659601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:09.172464 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.172431 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:09.251588 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.251557 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:09.805868 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.805824 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42"] Jul 22 13:51:09.810414 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.810390 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:09.812953 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.812935 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 13:51:09.813245 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.813227 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 13:51:09.813767 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.813754 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvs8w\"" Jul 22 13:51:09.821558 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.821535 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42"] Jul 22 13:51:09.923407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.923371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:09.923407 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.923418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jm74\" (UniqueName: \"kubernetes.io/projected/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-kube-api-access-6jm74\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:09.923629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:09.923520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.024848 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.024792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.025046 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.024881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.025046 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.024939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jm74\" (UniqueName: \"kubernetes.io/projected/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-kube-api-access-6jm74\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.025205 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.025182 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.025267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.025201 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.038454 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.038428 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jm74\" (UniqueName: \"kubernetes.io/projected/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-kube-api-access-6jm74\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.120587 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.120541 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:10.255025 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:10.255003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42"] Jul 22 13:51:10.257328 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:51:10.257304 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfaa1e0_d5cb_4edd_acd5_9f98d8fd57dc.slice/crio-92f814c21cc24c15b6dd45b387ce41958ba8f3e166331c80d7e21c7505e381d8 WatchSource:0}: Error finding container 92f814c21cc24c15b6dd45b387ce41958ba8f3e166331c80d7e21c7505e381d8: Status 404 returned error can't find the container with id 92f814c21cc24c15b6dd45b387ce41958ba8f3e166331c80d7e21c7505e381d8 Jul 22 13:51:11.036858 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:11.036826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" event={"ID":"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc","Type":"ContainerStarted","Data":"92f814c21cc24c15b6dd45b387ce41958ba8f3e166331c80d7e21c7505e381d8"} Jul 22 13:51:13.695583 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:13.695549 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:51:13.700694 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:13.700668 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:51:13.710682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:13.710659 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 13:51:18.068024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:18.067991 2556 generic.go:356] "Generic (PLEG): container finished" podID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerID="33bd5852378c840eb4bcebd8d71d8b722b6963b9a5e214368cde0d1622f13949" exitCode=0 Jul 22 13:51:18.068426 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:18.068049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" event={"ID":"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc","Type":"ContainerDied","Data":"33bd5852378c840eb4bcebd8d71d8b722b6963b9a5e214368cde0d1622f13949"} Jul 22 13:51:18.069017 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:18.069001 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:51:21.082027 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:21.081991 2556 generic.go:356] "Generic (PLEG): container finished" podID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerID="64c3c00152b403fe1d77ec90a2f892aa6ee79c37e8034261f54e482795d08326" exitCode=0 Jul 22 13:51:21.082396 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:21.082043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" event={"ID":"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc","Type":"ContainerDied","Data":"64c3c00152b403fe1d77ec90a2f892aa6ee79c37e8034261f54e482795d08326"} Jul 22 13:51:29.117930 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:29.117883 2556 generic.go:356] "Generic (PLEG): container finished" podID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerID="7c5ca17625b68b4d8196e82adf43b7fa074a71ceb1e887fde1497e5aa9ddecca" exitCode=0 Jul 22 13:51:29.118334 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:29.117973 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" event={"ID":"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc","Type":"ContainerDied","Data":"7c5ca17625b68b4d8196e82adf43b7fa074a71ceb1e887fde1497e5aa9ddecca"} Jul 22 13:51:30.245091 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.245069 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:30.401856 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.401772 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-util\") pod \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " Jul 22 13:51:30.401856 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.401843 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-bundle\") pod \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " Jul 22 13:51:30.402118 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.401899 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jm74\" (UniqueName: \"kubernetes.io/projected/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-kube-api-access-6jm74\") pod \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\" (UID: \"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc\") " Jul 22 13:51:30.402557 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.402528 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-bundle" (OuterVolumeSpecName: "bundle") pod "7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" (UID: "7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:51:30.404140 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.404116 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-kube-api-access-6jm74" (OuterVolumeSpecName: "kube-api-access-6jm74") pod "7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" (UID: "7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc"). InnerVolumeSpecName "kube-api-access-6jm74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:51:30.406517 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.406493 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-util" (OuterVolumeSpecName: "util") pod "7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" (UID: "7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:51:30.502717 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.502672 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:51:30.502717 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.502712 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jm74\" (UniqueName: \"kubernetes.io/projected/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-kube-api-access-6jm74\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:51:30.502717 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:30.502722 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:51:31.127384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:31.127357 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" Jul 22 13:51:31.127384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:31.127369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prv42" event={"ID":"7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc","Type":"ContainerDied","Data":"92f814c21cc24c15b6dd45b387ce41958ba8f3e166331c80d7e21c7505e381d8"} Jul 22 13:51:31.127636 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:31.127413 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92f814c21cc24c15b6dd45b387ce41958ba8f3e166331c80d7e21c7505e381d8" Jul 22 13:51:35.837196 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:35.837161 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:36.683661 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:36.683629 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:37.820486 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820456 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj"] Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820728 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="extract" Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820740 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="extract" Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820762 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="util" Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820769 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="util" Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820780 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="pull" Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820785 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="pull" Jul 22 13:51:37.820879 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.820828 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bfaa1e0-d5cb-4edd-acd5-9f98d8fd57dc" containerName="extract" Jul 22 13:51:37.823616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.823601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:37.826103 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.826077 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:51:37.826243 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.826173 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-crsnl\"" Jul 22 13:51:37.826319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.826295 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 13:51:37.833944 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.833893 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj"] Jul 22 13:51:37.856540 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.856520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgvs\" (UniqueName: \"kubernetes.io/projected/abba11a3-5fde-45e0-b999-02fdb0720437-kube-api-access-9sgvs\") pod \"cert-manager-operator-controller-manager-55c444bf86-vgwdj\" (UID: \"abba11a3-5fde-45e0-b999-02fdb0720437\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:37.856664 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.856561 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abba11a3-5fde-45e0-b999-02fdb0720437-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vgwdj\" (UID: \"abba11a3-5fde-45e0-b999-02fdb0720437\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:37.957315 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.957285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abba11a3-5fde-45e0-b999-02fdb0720437-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vgwdj\" (UID: \"abba11a3-5fde-45e0-b999-02fdb0720437\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:37.957483 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.957373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgvs\" (UniqueName: \"kubernetes.io/projected/abba11a3-5fde-45e0-b999-02fdb0720437-kube-api-access-9sgvs\") pod \"cert-manager-operator-controller-manager-55c444bf86-vgwdj\" (UID: \"abba11a3-5fde-45e0-b999-02fdb0720437\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:37.957677 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.957656 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abba11a3-5fde-45e0-b999-02fdb0720437-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vgwdj\" (UID: \"abba11a3-5fde-45e0-b999-02fdb0720437\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:37.967627 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:37.967604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgvs\" (UniqueName: \"kubernetes.io/projected/abba11a3-5fde-45e0-b999-02fdb0720437-kube-api-access-9sgvs\") pod \"cert-manager-operator-controller-manager-55c444bf86-vgwdj\" (UID: \"abba11a3-5fde-45e0-b999-02fdb0720437\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:38.132893 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:38.132863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" Jul 22 13:51:38.263704 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:38.263668 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj"] Jul 22 13:51:38.267027 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:51:38.266994 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabba11a3_5fde_45e0_b999_02fdb0720437.slice/crio-c2ed1dea8a767e541d8e475b45067002bcb578566ee4aec1db27b0af6ccaf230 WatchSource:0}: Error finding container c2ed1dea8a767e541d8e475b45067002bcb578566ee4aec1db27b0af6ccaf230: Status 404 returned error can't find the container with id c2ed1dea8a767e541d8e475b45067002bcb578566ee4aec1db27b0af6ccaf230 Jul 22 13:51:39.159817 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:39.159777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" event={"ID":"abba11a3-5fde-45e0-b999-02fdb0720437","Type":"ContainerStarted","Data":"c2ed1dea8a767e541d8e475b45067002bcb578566ee4aec1db27b0af6ccaf230"} Jul 22 13:51:39.496156 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:39.496058 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:39.596277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:39.596247 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:40.165395 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:40.165361 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" event={"ID":"abba11a3-5fde-45e0-b999-02fdb0720437","Type":"ContainerStarted","Data":"bdc3afc9a1ce85c6fe23fa87b33cad6cdb1d7d9bc5fca64acb424315ddd3bbeb"} Jul 22 13:51:40.185112 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:40.185060 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vgwdj" podStartSLOduration=1.5128177489999999 podStartE2EDuration="3.185039115s" totalImagesPullingTime="1.672221366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:51:40.18401474 +0000 UTC m=+326.834030810" watchObservedRunningTime="2026-07-22 13:51:40.185039115 +0000 UTC m=+326.835055157" Jul 22 13:51:40.558265 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:40.558211 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:40.659010 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:40.658979 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:41.482832 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.482799 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6"] Jul 22 13:51:41.486277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.486259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.488412 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.488393 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvs8w\"" Jul 22 13:51:41.488508 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.488395 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 13:51:41.488996 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.488978 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 13:51:41.496323 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.496296 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6"] Jul 22 13:51:41.584054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.584026 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.584212 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.584072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rc22\" (UniqueName: \"kubernetes.io/projected/4be2a426-7114-4a3e-9daf-e8fd26d12a30-kube-api-access-5rc22\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.584212 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.584157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.684723 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.684695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.684864 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.684737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.684864 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.684770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rc22\" (UniqueName: \"kubernetes.io/projected/4be2a426-7114-4a3e-9daf-e8fd26d12a30-kube-api-access-5rc22\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.685121 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.685099 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.685159 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.685120 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.693937 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.693890 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rc22\" (UniqueName: \"kubernetes.io/projected/4be2a426-7114-4a3e-9daf-e8fd26d12a30-kube-api-access-5rc22\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.706337 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.706316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:41.797570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.797511 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:41.818135 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.818108 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:41.926032 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:41.926008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6"] Jul 22 13:51:41.927789 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:51:41.927763 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be2a426_7114_4a3e_9daf_e8fd26d12a30.slice/crio-5bc07e401970b1487e5c7f9650440a63910c499839559bb088ed72633b159b18 WatchSource:0}: Error finding container 5bc07e401970b1487e5c7f9650440a63910c499839559bb088ed72633b159b18: Status 404 returned error can't find the container with id 5bc07e401970b1487e5c7f9650440a63910c499839559bb088ed72633b159b18 Jul 22 13:51:42.175080 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:42.175053 2556 generic.go:356] "Generic (PLEG): container finished" podID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerID="bb346b92bd8ac1fd942ac9a4727ca3b377357c9179a97be240b51597805da8f0" exitCode=0 Jul 22 13:51:42.175230 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:42.175112 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" event={"ID":"4be2a426-7114-4a3e-9daf-e8fd26d12a30","Type":"ContainerDied","Data":"bb346b92bd8ac1fd942ac9a4727ca3b377357c9179a97be240b51597805da8f0"} Jul 22 13:51:42.175230 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:42.175147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" event={"ID":"4be2a426-7114-4a3e-9daf-e8fd26d12a30","Type":"ContainerStarted","Data":"5bc07e401970b1487e5c7f9650440a63910c499839559bb088ed72633b159b18"} Jul 22 13:51:43.920567 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:43.920535 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:44.121319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.121287 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:44.319696 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.319625 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q"] Jul 22 13:51:44.322945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.322926 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.325139 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.325120 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 13:51:44.325220 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.325122 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s7f9g\"" Jul 22 13:51:44.325977 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.325950 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 13:51:44.333875 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.333856 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q"] Jul 22 13:51:44.403753 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.403730 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52b5ba61-ea3b-4371-8711-993edea0a126-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z9b2q\" (UID: \"52b5ba61-ea3b-4371-8711-993edea0a126\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.403851 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.403765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmph5\" (UniqueName: \"kubernetes.io/projected/52b5ba61-ea3b-4371-8711-993edea0a126-kube-api-access-gmph5\") pod \"cert-manager-cainjector-559cdd8c87-z9b2q\" (UID: \"52b5ba61-ea3b-4371-8711-993edea0a126\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.504150 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.504125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52b5ba61-ea3b-4371-8711-993edea0a126-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z9b2q\" (UID: \"52b5ba61-ea3b-4371-8711-993edea0a126\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.504259 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.504160 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmph5\" (UniqueName: \"kubernetes.io/projected/52b5ba61-ea3b-4371-8711-993edea0a126-kube-api-access-gmph5\") pod \"cert-manager-cainjector-559cdd8c87-z9b2q\" (UID: \"52b5ba61-ea3b-4371-8711-993edea0a126\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.517686 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.517652 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52b5ba61-ea3b-4371-8711-993edea0a126-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-z9b2q\" (UID: \"52b5ba61-ea3b-4371-8711-993edea0a126\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.517776 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.517652 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmph5\" (UniqueName: \"kubernetes.io/projected/52b5ba61-ea3b-4371-8711-993edea0a126-kube-api-access-gmph5\") pod \"cert-manager-cainjector-559cdd8c87-z9b2q\" (UID: \"52b5ba61-ea3b-4371-8711-993edea0a126\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.642776 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.642751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" Jul 22 13:51:44.768036 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:44.768011 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q"] Jul 22 13:51:44.770319 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:51:44.770295 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52b5ba61_ea3b_4371_8711_993edea0a126.slice/crio-5e9b90ea03ad9a0ca040a329beae2e65b0bc17191e142362c4b583ed8c399f08 WatchSource:0}: Error finding container 5e9b90ea03ad9a0ca040a329beae2e65b0bc17191e142362c4b583ed8c399f08: Status 404 returned error can't find the container with id 5e9b90ea03ad9a0ca040a329beae2e65b0bc17191e142362c4b583ed8c399f08 Jul 22 13:51:45.190372 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:45.190341 2556 generic.go:356] "Generic (PLEG): container finished" podID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerID="1142aaab1f9e44dcf420710e10bdf29f8a953e1001662a98c17838c32e4e8ece" exitCode=0 Jul 22 13:51:45.190785 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:45.190418 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" event={"ID":"4be2a426-7114-4a3e-9daf-e8fd26d12a30","Type":"ContainerDied","Data":"1142aaab1f9e44dcf420710e10bdf29f8a953e1001662a98c17838c32e4e8ece"} Jul 22 13:51:45.191590 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:45.191562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" event={"ID":"52b5ba61-ea3b-4371-8711-993edea0a126","Type":"ContainerStarted","Data":"5e9b90ea03ad9a0ca040a329beae2e65b0bc17191e142362c4b583ed8c399f08"} Jul 22 13:51:46.199183 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:46.199143 2556 generic.go:356] "Generic (PLEG): container finished" podID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerID="93347cc02f6807dfc612faef7a6fc4806d228fcbf30bf844dc6e2253e030b674" exitCode=0 Jul 22 13:51:46.199636 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:46.199225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" event={"ID":"4be2a426-7114-4a3e-9daf-e8fd26d12a30","Type":"ContainerDied","Data":"93347cc02f6807dfc612faef7a6fc4806d228fcbf30bf844dc6e2253e030b674"} Jul 22 13:51:46.245758 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:46.245730 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:46.306311 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:46.306280 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:47.367538 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.367517 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:47.423976 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.423952 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rc22\" (UniqueName: \"kubernetes.io/projected/4be2a426-7114-4a3e-9daf-e8fd26d12a30-kube-api-access-5rc22\") pod \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " Jul 22 13:51:47.424083 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.424032 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-util\") pod \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " Jul 22 13:51:47.424152 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.424083 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-bundle\") pod \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\" (UID: \"4be2a426-7114-4a3e-9daf-e8fd26d12a30\") " Jul 22 13:51:47.424400 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.424376 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-bundle" (OuterVolumeSpecName: "bundle") pod "4be2a426-7114-4a3e-9daf-e8fd26d12a30" (UID: "4be2a426-7114-4a3e-9daf-e8fd26d12a30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:51:47.426543 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.426523 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be2a426-7114-4a3e-9daf-e8fd26d12a30-kube-api-access-5rc22" (OuterVolumeSpecName: "kube-api-access-5rc22") pod "4be2a426-7114-4a3e-9daf-e8fd26d12a30" (UID: "4be2a426-7114-4a3e-9daf-e8fd26d12a30"). InnerVolumeSpecName "kube-api-access-5rc22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:51:47.428288 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.428261 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-util" (OuterVolumeSpecName: "util") pod "4be2a426-7114-4a3e-9daf-e8fd26d12a30" (UID: "4be2a426-7114-4a3e-9daf-e8fd26d12a30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:51:47.524834 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.524751 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:51:47.524834 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.524774 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4be2a426-7114-4a3e-9daf-e8fd26d12a30-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:51:47.524834 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:47.524783 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rc22\" (UniqueName: \"kubernetes.io/projected/4be2a426-7114-4a3e-9daf-e8fd26d12a30-kube-api-access-5rc22\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:51:48.159417 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.159385 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:48.211094 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.211069 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" Jul 22 13:51:48.211236 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.211065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7x2k6" event={"ID":"4be2a426-7114-4a3e-9daf-e8fd26d12a30","Type":"ContainerDied","Data":"5bc07e401970b1487e5c7f9650440a63910c499839559bb088ed72633b159b18"} Jul 22 13:51:48.211236 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.211182 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bc07e401970b1487e5c7f9650440a63910c499839559bb088ed72633b159b18" Jul 22 13:51:48.212689 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.212664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" event={"ID":"52b5ba61-ea3b-4371-8711-993edea0a126","Type":"ContainerStarted","Data":"0efac15922cf1a724dc3c632daa742e482874927060078de075f59c439636a45"} Jul 22 13:51:48.228497 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.228383 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-z9b2q" podStartSLOduration=1.640408417 podStartE2EDuration="4.228357839s" totalImagesPullingTime="2.587949422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:51:48.228178293 +0000 UTC m=+334.878194337" watchObservedRunningTime="2026-07-22 13:51:48.228357839 +0000 UTC m=+334.878373881" Jul 22 13:51:48.236304 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:48.236282 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:49.849795 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:49.849763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:49.946087 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:49.946057 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:51.901187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901152 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8"] Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901445 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="util" Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901456 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="util" Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901474 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="extract" Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901479 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="extract" Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901491 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="pull" Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901496 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="pull" Jul 22 13:51:51.901570 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.901544 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be2a426-7114-4a3e-9daf-e8fd26d12a30" containerName="extract" Jul 22 13:51:51.904631 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.904614 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:51.906968 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.906943 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 13:51:51.907098 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.907011 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 13:51:51.907600 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.907582 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ldb66\"" Jul 22 13:51:51.915005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.914981 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8"] Jul 22 13:51:51.959443 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.959414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9t9k\" (UniqueName: \"kubernetes.io/projected/2c272a24-9706-482b-a8b3-433e2e8c2c36-kube-api-access-n9t9k\") pod \"openshift-lws-operator-fd8ccff4c-ll8m8\" (UID: \"2c272a24-9706-482b-a8b3-433e2e8c2c36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:51.959588 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:51.959451 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c272a24-9706-482b-a8b3-433e2e8c2c36-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ll8m8\" (UID: \"2c272a24-9706-482b-a8b3-433e2e8c2c36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:52.059895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.059856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c272a24-9706-482b-a8b3-433e2e8c2c36-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ll8m8\" (UID: \"2c272a24-9706-482b-a8b3-433e2e8c2c36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:52.060088 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.059972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9t9k\" (UniqueName: \"kubernetes.io/projected/2c272a24-9706-482b-a8b3-433e2e8c2c36-kube-api-access-n9t9k\") pod \"openshift-lws-operator-fd8ccff4c-ll8m8\" (UID: \"2c272a24-9706-482b-a8b3-433e2e8c2c36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:52.060313 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.060295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c272a24-9706-482b-a8b3-433e2e8c2c36-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ll8m8\" (UID: \"2c272a24-9706-482b-a8b3-433e2e8c2c36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:52.071571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.071546 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9t9k\" (UniqueName: \"kubernetes.io/projected/2c272a24-9706-482b-a8b3-433e2e8c2c36-kube-api-access-n9t9k\") pod \"openshift-lws-operator-fd8ccff4c-ll8m8\" (UID: \"2c272a24-9706-482b-a8b3-433e2e8c2c36\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:52.158247 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.158149 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:52.213954 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.213897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" Jul 22 13:51:52.346606 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:52.346580 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8"] Jul 22 13:51:52.348917 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:51:52.348888 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c272a24_9706_482b_a8b3_433e2e8c2c36.slice/crio-693d2eb9db81d63270cd7085e9178e7fa0eba8934ffef4ddd8759babcaca563d WatchSource:0}: Error finding container 693d2eb9db81d63270cd7085e9178e7fa0eba8934ffef4ddd8759babcaca563d: Status 404 returned error can't find the container with id 693d2eb9db81d63270cd7085e9178e7fa0eba8934ffef4ddd8759babcaca563d Jul 22 13:51:53.240027 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:53.239991 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" event={"ID":"2c272a24-9706-482b-a8b3-433e2e8c2c36","Type":"ContainerStarted","Data":"693d2eb9db81d63270cd7085e9178e7fa0eba8934ffef4ddd8759babcaca563d"} Jul 22 13:51:54.246216 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:54.246126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" event={"ID":"2c272a24-9706-482b-a8b3-433e2e8c2c36","Type":"ContainerStarted","Data":"6ed90242e23d6593d815724ff253bf72de560d0195d77c1aa8a460fcf39ab313"} Jul 22 13:51:54.262199 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:54.262141 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ll8m8" podStartSLOduration=1.676880098 podStartE2EDuration="3.262117938s" totalImagesPullingTime="1.58523784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:51:54.261967307 +0000 UTC m=+340.911983346" watchObservedRunningTime="2026-07-22 13:51:54.262117938 +0000 UTC m=+340.912133978" Jul 22 13:51:55.016583 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:55.016548 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:55.113384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:55.113353 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:56.918951 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.918919 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g"] Jul 22 13:51:56.922502 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.922483 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:56.924710 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.924684 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvs8w\"" Jul 22 13:51:56.924867 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.924823 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 13:51:56.925627 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.925604 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 13:51:56.930967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.930942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g"] Jul 22 13:51:56.998345 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.998304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr58n\" (UniqueName: \"kubernetes.io/projected/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-kube-api-access-wr58n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:56.998345 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.998348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:56.998585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:56.998386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.099689 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.099647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.099850 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.099762 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr58n\" (UniqueName: \"kubernetes.io/projected/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-kube-api-access-wr58n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.099850 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.099800 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.100115 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.100096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.100248 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.100154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.107616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.107587 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr58n\" (UniqueName: \"kubernetes.io/projected/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-kube-api-access-wr58n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.232761 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.232657 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:51:57.365251 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.365202 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g"] Jul 22 13:51:57.367465 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:51:57.367438 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e3a980_dc79_43d2_a6ca_0f2e99bcc6a7.slice/crio-f4474d7b5e7871183822ae5d4694cb5a95b4ebfb61c470a8d26f6d43a3246e4e WatchSource:0}: Error finding container f4474d7b5e7871183822ae5d4694cb5a95b4ebfb61c470a8d26f6d43a3246e4e: Status 404 returned error can't find the container with id f4474d7b5e7871183822ae5d4694cb5a95b4ebfb61c470a8d26f6d43a3246e4e Jul 22 13:51:57.673410 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:57.673381 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:51:58.264571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:58.264535 2556 generic.go:356] "Generic (PLEG): container finished" podID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerID="b6cc6384e089ef9dd70838048f03bc576b6afc2122ad6325596f41d7445cd7c5" exitCode=0 Jul 22 13:51:58.265062 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:58.264592 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" event={"ID":"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7","Type":"ContainerDied","Data":"b6cc6384e089ef9dd70838048f03bc576b6afc2122ad6325596f41d7445cd7c5"} Jul 22 13:51:58.265062 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:58.264627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" event={"ID":"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7","Type":"ContainerStarted","Data":"f4474d7b5e7871183822ae5d4694cb5a95b4ebfb61c470a8d26f6d43a3246e4e"} Jul 22 13:51:59.271189 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:59.271159 2556 generic.go:356] "Generic (PLEG): container finished" podID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerID="177d9105d65d2ea2aba515678701ee3d88a32d2f3620e67e2c4da402e705d7c1" exitCode=0 Jul 22 13:51:59.271498 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:51:59.271198 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" event={"ID":"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7","Type":"ContainerDied","Data":"177d9105d65d2ea2aba515678701ee3d88a32d2f3620e67e2c4da402e705d7c1"} Jul 22 13:52:00.277718 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:00.277682 2556 generic.go:356] "Generic (PLEG): container finished" podID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerID="1348cc7d420d5fc07bd5189d41186b0032c82d7a2acc5e57e28727e9dc351ad3" exitCode=0 Jul 22 13:52:00.278152 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:00.277749 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" event={"ID":"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7","Type":"ContainerDied","Data":"1348cc7d420d5fc07bd5189d41186b0032c82d7a2acc5e57e28727e9dc351ad3"} Jul 22 13:52:01.426526 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.426497 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:52:01.538089 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.538006 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr58n\" (UniqueName: \"kubernetes.io/projected/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-kube-api-access-wr58n\") pod \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " Jul 22 13:52:01.538089 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.538075 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-bundle\") pod \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " Jul 22 13:52:01.538316 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.538097 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-util\") pod \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\" (UID: \"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7\") " Jul 22 13:52:01.538754 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.538731 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-bundle" (OuterVolumeSpecName: "bundle") pod "a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" (UID: "a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:52:01.540150 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.540127 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-kube-api-access-wr58n" (OuterVolumeSpecName: "kube-api-access-wr58n") pod "a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" (UID: "a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7"). InnerVolumeSpecName "kube-api-access-wr58n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:52:01.543872 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.543850 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-util" (OuterVolumeSpecName: "util") pod "a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" (UID: "a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:52:01.639400 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.639368 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:52:01.639400 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.639394 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:52:01.639400 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:01.639405 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr58n\" (UniqueName: \"kubernetes.io/projected/a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7-kube-api-access-wr58n\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:52:02.289110 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:02.289068 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" event={"ID":"a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7","Type":"ContainerDied","Data":"f4474d7b5e7871183822ae5d4694cb5a95b4ebfb61c470a8d26f6d43a3246e4e"} Jul 22 13:52:02.289110 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:02.289098 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9d66g" Jul 22 13:52:02.289391 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:02.289131 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4474d7b5e7871183822ae5d4694cb5a95b4ebfb61c470a8d26f6d43a3246e4e" Jul 22 13:52:13.654730 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:13.654649 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:13.749639 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:13.749605 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:14.271711 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.271678 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:14.438363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.438331 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:14.542940 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.542848 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:14.595718 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.595693 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft"] Jul 22 13:52:14.596012 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.595999 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="util" Jul 22 13:52:14.596074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.596013 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="util" Jul 22 13:52:14.596074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.596027 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="extract" Jul 22 13:52:14.596074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.596033 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="extract" Jul 22 13:52:14.596074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.596043 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="pull" Jul 22 13:52:14.596074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.596048 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="pull" Jul 22 13:52:14.596220 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.596092 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e3a980-dc79-43d2-a6ca-0f2e99bcc6a7" containerName="extract" Jul 22 13:52:14.602813 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.602793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.606105 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.606084 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 13:52:14.606257 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.606243 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 13:52:14.607014 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.606991 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 13:52:14.607122 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.607013 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n778k\"" Jul 22 13:52:14.607122 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.607031 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 13:52:14.612980 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.612960 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft"] Jul 22 13:52:14.715307 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.715273 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:14.748462 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.748438 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/707d278c-4c71-49c7-b241-8f17a25bd042-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.748628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.748466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw74p\" (UniqueName: \"kubernetes.io/projected/707d278c-4c71-49c7-b241-8f17a25bd042-kube-api-access-lw74p\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.748628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.748492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707d278c-4c71-49c7-b241-8f17a25bd042-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.748628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.748585 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/707d278c-4c71-49c7-b241-8f17a25bd042-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.748769 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.748650 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/707d278c-4c71-49c7-b241-8f17a25bd042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.813462 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.813396 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:14.849051 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.849026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/707d278c-4c71-49c7-b241-8f17a25bd042-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.849157 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.849078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/707d278c-4c71-49c7-b241-8f17a25bd042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.849157 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.849133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/707d278c-4c71-49c7-b241-8f17a25bd042-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.849271 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.849157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw74p\" (UniqueName: \"kubernetes.io/projected/707d278c-4c71-49c7-b241-8f17a25bd042-kube-api-access-lw74p\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.849271 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.849186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707d278c-4c71-49c7-b241-8f17a25bd042-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.849482 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.849459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/707d278c-4c71-49c7-b241-8f17a25bd042-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.851445 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.851422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/707d278c-4c71-49c7-b241-8f17a25bd042-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.851556 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.851538 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/707d278c-4c71-49c7-b241-8f17a25bd042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.851598 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.851554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/707d278c-4c71-49c7-b241-8f17a25bd042-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.856863 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.856842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw74p\" (UniqueName: \"kubernetes.io/projected/707d278c-4c71-49c7-b241-8f17a25bd042-kube-api-access-lw74p\") pod \"opendatahub-operator-controller-manager-65657c6f45-lnlft\" (UID: \"707d278c-4c71-49c7-b241-8f17a25bd042\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.913896 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.913871 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:14.952925 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:14.952893 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:15.054201 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:15.054172 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:15.059586 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:15.059562 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft"] Jul 22 13:52:15.062105 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:52:15.062077 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707d278c_4c71_49c7_b241_8f17a25bd042.slice/crio-1577e42d070a4e6da040fe306dbbf0b928793c77c644e99a8a5623d3120f11ed WatchSource:0}: Error finding container 1577e42d070a4e6da040fe306dbbf0b928793c77c644e99a8a5623d3120f11ed: Status 404 returned error can't find the container with id 1577e42d070a4e6da040fe306dbbf0b928793c77c644e99a8a5623d3120f11ed Jul 22 13:52:15.150694 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:15.150664 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:15.345895 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:15.345857 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" event={"ID":"707d278c-4c71-49c7-b241-8f17a25bd042","Type":"ContainerStarted","Data":"1577e42d070a4e6da040fe306dbbf0b928793c77c644e99a8a5623d3120f11ed"} Jul 22 13:52:18.363949 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:18.363891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" event={"ID":"707d278c-4c71-49c7-b241-8f17a25bd042","Type":"ContainerStarted","Data":"c94fd0f06e026abcfcb233913a095c1b72ad37243d59adcfadca30625bd222ed"} Jul 22 13:52:19.369839 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:19.369804 2556 generic.go:356] "Generic (PLEG): container finished" podID="707d278c-4c71-49c7-b241-8f17a25bd042" containerID="c94fd0f06e026abcfcb233913a095c1b72ad37243d59adcfadca30625bd222ed" exitCode=0 Jul 22 13:52:19.370250 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:19.369867 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" event={"ID":"707d278c-4c71-49c7-b241-8f17a25bd042","Type":"ContainerDied","Data":"c94fd0f06e026abcfcb233913a095c1b72ad37243d59adcfadca30625bd222ed"} Jul 22 13:52:20.376444 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:20.376407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" event={"ID":"707d278c-4c71-49c7-b241-8f17a25bd042","Type":"ContainerStarted","Data":"113bfb928e5a5702ac4398f714885d83e6498ebcd5523d644d1949c40397071b"} Jul 22 13:52:20.376845 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:20.376561 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:20.400441 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:20.400384 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" podStartSLOduration=1.914199011 podStartE2EDuration="6.400365242s" totalImagesPullingTime="3.448092504s" totalInitContainerRuntime="1.038073727s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:20.398882888 +0000 UTC m=+367.048898943" watchObservedRunningTime="2026-07-22 13:52:20.400365242 +0000 UTC m=+367.050381284" Jul 22 13:52:25.835950 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:25.835897 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:25.940547 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:25.940514 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:31.383752 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:31.383722 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-lnlft" Jul 22 13:52:33.464860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:33.464820 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:33.712677 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:33.712648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:34.118554 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:34.118524 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:34.217873 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:34.217839 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:34.317387 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:34.317359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:34.419358 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:34.419270 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:34.521461 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:34.521427 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:34.742266 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:34.742170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:35.062589 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:35.062489 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:38.210465 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.210424 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:38.298865 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.298812 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:38.299144 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.299125 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk"] Jul 22 13:52:38.302376 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.302361 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.305121 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.305099 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 13:52:38.305842 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.305828 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 13:52:38.306571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.306557 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 13:52:38.308790 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.308779 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gdw7h\"" Jul 22 13:52:38.319332 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.319312 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk"] Jul 22 13:52:38.440459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.440427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53bef0f0-865e-4761-9074-1b1a14479e32-metrics-cert\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.440459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.440463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53bef0f0-865e-4761-9074-1b1a14479e32-cert\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.440685 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.440483 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wwf\" (UniqueName: \"kubernetes.io/projected/53bef0f0-865e-4761-9074-1b1a14479e32-kube-api-access-v4wwf\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.440685 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.440595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53bef0f0-865e-4761-9074-1b1a14479e32-manager-config\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.541512 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.541433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53bef0f0-865e-4761-9074-1b1a14479e32-manager-config\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.541512 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.541486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53bef0f0-865e-4761-9074-1b1a14479e32-metrics-cert\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.541512 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.541509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53bef0f0-865e-4761-9074-1b1a14479e32-cert\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.541731 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.541536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wwf\" (UniqueName: \"kubernetes.io/projected/53bef0f0-865e-4761-9074-1b1a14479e32-kube-api-access-v4wwf\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.542139 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.542105 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53bef0f0-865e-4761-9074-1b1a14479e32-manager-config\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.543920 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.543886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53bef0f0-865e-4761-9074-1b1a14479e32-metrics-cert\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.544035 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.543969 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53bef0f0-865e-4761-9074-1b1a14479e32-cert\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.549299 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.549268 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wwf\" (UniqueName: \"kubernetes.io/projected/53bef0f0-865e-4761-9074-1b1a14479e32-kube-api-access-v4wwf\") pod \"lws-controller-manager-85c77b7bd5-nmtlk\" (UID: \"53bef0f0-865e-4761-9074-1b1a14479e32\") " pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.611222 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.611185 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:38.746385 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:38.746356 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk"] Jul 22 13:52:38.749852 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:52:38.749810 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bef0f0_865e_4761_9074_1b1a14479e32.slice/crio-a0bf3b85ae5bf0899bcc0ba5bce05f434983f30e28a4b5f61f1e6bb4dcc27041 WatchSource:0}: Error finding container a0bf3b85ae5bf0899bcc0ba5bce05f434983f30e28a4b5f61f1e6bb4dcc27041: Status 404 returned error can't find the container with id a0bf3b85ae5bf0899bcc0ba5bce05f434983f30e28a4b5f61f1e6bb4dcc27041 Jul 22 13:52:39.471652 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:39.471620 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" event={"ID":"53bef0f0-865e-4761-9074-1b1a14479e32","Type":"ContainerStarted","Data":"a0bf3b85ae5bf0899bcc0ba5bce05f434983f30e28a4b5f61f1e6bb4dcc27041"} Jul 22 13:52:39.749398 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:39.749314 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:41.482833 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:41.482798 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" event={"ID":"53bef0f0-865e-4761-9074-1b1a14479e32","Type":"ContainerStarted","Data":"1a97f813f95efcffaedc089844a4ad83dcb3707c6defb19eb9dda10e575ca554"} Jul 22 13:52:41.483313 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:41.482933 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:41.507419 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:41.507377 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" podStartSLOduration=1.776940265 podStartE2EDuration="3.507363749s" totalImagesPullingTime="1.730423484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:41.506387789 +0000 UTC m=+388.156403828" watchObservedRunningTime="2026-07-22 13:52:41.507363749 +0000 UTC m=+388.157379817" Jul 22 13:52:43.839454 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:43.839417 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:43.925691 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:43.925664 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:44.221857 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:44.221831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:44.326363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:44.326335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:44.452088 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:44.452059 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:44.550249 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:44.550137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:45.159284 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:45.159253 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:45.249082 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:45.249032 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:46.179155 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:46.179117 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:46.273194 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:46.273165 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:47.279204 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:47.279178 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:51.152628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.152593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:51.256075 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.256038 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:51.685894 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.685863 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx"] Jul 22 13:52:51.692229 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.692209 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.694639 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.694615 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-f5cf4\"" Jul 22 13:52:51.694770 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.694732 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 13:52:51.701054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.701030 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx"] Jul 22 13:52:51.720073 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.720051 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:51.753068 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753201 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753201 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753099 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrmtb\" (UniqueName: \"kubernetes.io/projected/ab08f22d-4126-4123-b249-a3c340549298-kube-api-access-qrmtb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753201 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab08f22d-4126-4123-b249-a3c340549298-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab08f22d-4126-4123-b249-a3c340549298-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753319 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.753440 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.753339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab08f22d-4126-4123-b249-a3c340549298-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854012 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.853977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854016 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrmtb\" (UniqueName: \"kubernetes.io/projected/ab08f22d-4126-4123-b249-a3c340549298-kube-api-access-qrmtb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab08f22d-4126-4123-b249-a3c340549298-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab08f22d-4126-4123-b249-a3c340549298-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854202 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854416 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854416 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854416 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab08f22d-4126-4123-b249-a3c340549298-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854553 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854717 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854697 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854811 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854745 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854811 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854889 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.854967 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.854885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab08f22d-4126-4123-b249-a3c340549298-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.856601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.856583 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab08f22d-4126-4123-b249-a3c340549298-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.856897 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.856880 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab08f22d-4126-4123-b249-a3c340549298-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.865148 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.865121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab08f22d-4126-4123-b249-a3c340549298-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.865441 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.865419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrmtb\" (UniqueName: \"kubernetes.io/projected/ab08f22d-4126-4123-b249-a3c340549298-kube-api-access-qrmtb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hszzx\" (UID: \"ab08f22d-4126-4123-b249-a3c340549298\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:51.917502 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:51.917458 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:52.004315 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:52.004216 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:52.035590 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:52.035559 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:52:52.139050 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:52.139027 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx"] Jul 22 13:52:52.140656 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:52:52.140625 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab08f22d_4126_4123_b249_a3c340549298.slice/crio-3fbd2ba219582038ae2873ef2048975f6932449e06722d29543293b36c20b1e6 WatchSource:0}: Error finding container 3fbd2ba219582038ae2873ef2048975f6932449e06722d29543293b36c20b1e6: Status 404 returned error can't find the container with id 3fbd2ba219582038ae2873ef2048975f6932449e06722d29543293b36c20b1e6 Jul 22 13:52:52.490969 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:52.490941 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85c77b7bd5-nmtlk" Jul 22 13:52:52.537626 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:52.537585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" event={"ID":"ab08f22d-4126-4123-b249-a3c340549298","Type":"ContainerStarted","Data":"3fbd2ba219582038ae2873ef2048975f6932449e06722d29543293b36c20b1e6"} Jul 22 13:52:55.074144 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:55.074100 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:52:55.074522 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:55.074220 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:52:55.074522 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:55.074272 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:52:55.555857 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:55.555820 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" event={"ID":"ab08f22d-4126-4123-b249-a3c340549298","Type":"ContainerStarted","Data":"c83453f759bfebc1abe762cb8e82cf8c82fa2f2d077061748988e1baaf5143a6"} Jul 22 13:52:55.576618 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:55.576568 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" podStartSLOduration=1.645337432 podStartE2EDuration="4.576552839s" totalImagesPullingTime="2.931215407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:55.574607297 +0000 UTC m=+402.224623338" watchObservedRunningTime="2026-07-22 13:52:55.576552839 +0000 UTC m=+402.226568879" Jul 22 13:52:56.005093 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:56.005056 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:56.029828 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:56.029798 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:56.560726 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:56.560698 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:52:56.561805 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:52:56.561789 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hszzx" Jul 22 13:53:35.018711 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.018663 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:53:35.117793 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.117760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:53:35.138744 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.138712 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prm4m"] Jul 22 13:53:35.149739 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.149710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:35.151448 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.151418 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prm4m"] Jul 22 13:53:35.152620 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.152593 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 13:53:35.152766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.152669 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 13:53:35.152766 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.152716 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dtxh8\"" Jul 22 13:53:35.199813 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.199774 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:53:35.230009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.229968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ckg\" (UniqueName: \"kubernetes.io/projected/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950-kube-api-access-f9ckg\") pod \"kuadrant-operator-catalog-prm4m\" (UID: \"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950\") " pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:35.330652 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.330554 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ckg\" (UniqueName: \"kubernetes.io/projected/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950-kube-api-access-f9ckg\") pod \"kuadrant-operator-catalog-prm4m\" (UID: \"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950\") " pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:35.342505 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.342482 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ckg\" (UniqueName: \"kubernetes.io/projected/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950-kube-api-access-f9ckg\") pod \"kuadrant-operator-catalog-prm4m\" (UID: \"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950\") " pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:35.467363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.467327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:35.508982 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.508884 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prm4m"] Jul 22 13:53:35.602025 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.601999 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prm4m"] Jul 22 13:53:35.604739 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:53:35.604712 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c11a6f6_fbbb_4fa0_8451_74c97f4cc950.slice/crio-f1001caa264735e887ae55804dbb09937ed60e192a5d150f915cfbfa8305284f WatchSource:0}: Error finding container f1001caa264735e887ae55804dbb09937ed60e192a5d150f915cfbfa8305284f: Status 404 returned error can't find the container with id f1001caa264735e887ae55804dbb09937ed60e192a5d150f915cfbfa8305284f Jul 22 13:53:35.719783 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.719738 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tscq"] Jul 22 13:53:35.723422 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.723398 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:35.731483 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.731459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tscq"] Jul 22 13:53:35.734353 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.734307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqb4\" (UniqueName: \"kubernetes.io/projected/5157bb87-142f-42b7-b871-3dfcf3c1a84b-kube-api-access-8mqb4\") pod \"kuadrant-operator-catalog-6tscq\" (UID: \"5157bb87-142f-42b7-b871-3dfcf3c1a84b\") " pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:35.740005 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.739980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" event={"ID":"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950","Type":"ContainerStarted","Data":"f1001caa264735e887ae55804dbb09937ed60e192a5d150f915cfbfa8305284f"} Jul 22 13:53:35.835529 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.835485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqb4\" (UniqueName: \"kubernetes.io/projected/5157bb87-142f-42b7-b871-3dfcf3c1a84b-kube-api-access-8mqb4\") pod \"kuadrant-operator-catalog-6tscq\" (UID: \"5157bb87-142f-42b7-b871-3dfcf3c1a84b\") " pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:35.844964 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:35.844928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqb4\" (UniqueName: \"kubernetes.io/projected/5157bb87-142f-42b7-b871-3dfcf3c1a84b-kube-api-access-8mqb4\") pod \"kuadrant-operator-catalog-6tscq\" (UID: \"5157bb87-142f-42b7-b871-3dfcf3c1a84b\") " pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:36.034361 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:36.034262 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:36.185467 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:36.185435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tscq"] Jul 22 13:53:36.222117 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:53:36.222086 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5157bb87_142f_42b7_b871_3dfcf3c1a84b.slice/crio-de889cad0a4da99f64df4a030b59dd7e076ddf6b060e5e8215595c85321d6981 WatchSource:0}: Error finding container de889cad0a4da99f64df4a030b59dd7e076ddf6b060e5e8215595c85321d6981: Status 404 returned error can't find the container with id de889cad0a4da99f64df4a030b59dd7e076ddf6b060e5e8215595c85321d6981 Jul 22 13:53:36.749429 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:36.749384 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" event={"ID":"5157bb87-142f-42b7-b871-3dfcf3c1a84b","Type":"ContainerStarted","Data":"de889cad0a4da99f64df4a030b59dd7e076ddf6b060e5e8215595c85321d6981"} Jul 22 13:53:37.755899 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:37.755855 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" event={"ID":"5157bb87-142f-42b7-b871-3dfcf3c1a84b","Type":"ContainerStarted","Data":"1dd1832152633bbebb05b8413d1e99c5e72e8db23b22ed36969abe09207cd7f4"} Jul 22 13:53:37.757333 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:37.757310 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" event={"ID":"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950","Type":"ContainerStarted","Data":"d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380"} Jul 22 13:53:37.757431 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:37.757410 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" podUID="9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" containerName="registry-server" containerID="cri-o://d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380" gracePeriod=2 Jul 22 13:53:37.781007 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:37.780947 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" podStartSLOduration=1.396953207 podStartE2EDuration="2.780928591s" totalImagesPullingTime="1.383975384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:53:37.778858097 +0000 UTC m=+444.428874129" watchObservedRunningTime="2026-07-22 13:53:37.780928591 +0000 UTC m=+444.430944629" Jul 22 13:53:37.802959 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:37.802887 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" podStartSLOduration=0.804347391 podStartE2EDuration="2.80287402s" totalImagesPullingTime="1.998526629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:53:37.801001615 +0000 UTC m=+444.451017655" watchObservedRunningTime="2026-07-22 13:53:37.80287402 +0000 UTC m=+444.452890110" Jul 22 13:53:37.999083 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:37.999051 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-prm4m_9c11a6f6-fbbb-4fa0-8451-74c97f4cc950/registry-server/0.log" Jul 22 13:53:38.001457 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.001442 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:38.051056 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.051017 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9ckg\" (UniqueName: \"kubernetes.io/projected/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950-kube-api-access-f9ckg\") pod \"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950\" (UID: \"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950\") " Jul 22 13:53:38.053238 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.053188 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950-kube-api-access-f9ckg" (OuterVolumeSpecName: "kube-api-access-f9ckg") pod "9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" (UID: "9c11a6f6-fbbb-4fa0-8451-74c97f4cc950"). InnerVolumeSpecName "kube-api-access-f9ckg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:53:38.152412 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.152326 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9ckg\" (UniqueName: \"kubernetes.io/projected/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950-kube-api-access-f9ckg\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:38.763188 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.763160 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-prm4m_9c11a6f6-fbbb-4fa0-8451-74c97f4cc950/registry-server/0.log" Jul 22 13:53:38.763601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.763199 2556 generic.go:356] "Generic (PLEG): container finished" podID="9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" containerID="d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380" exitCode=1 Jul 22 13:53:38.763601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.763228 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" event={"ID":"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950","Type":"ContainerDied","Data":"d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380"} Jul 22 13:53:38.763601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.763248 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" Jul 22 13:53:38.763601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.763279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prm4m" event={"ID":"9c11a6f6-fbbb-4fa0-8451-74c97f4cc950","Type":"ContainerDied","Data":"f1001caa264735e887ae55804dbb09937ed60e192a5d150f915cfbfa8305284f"} Jul 22 13:53:38.763601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.763301 2556 scope.go:117] "RemoveContainer" containerID="d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380" Jul 22 13:53:38.772658 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.772639 2556 scope.go:117] "RemoveContainer" containerID="d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380" Jul 22 13:53:38.772954 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:53:38.772922 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380\": container with ID starting with d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380 not found: ID does not exist" containerID="d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380" Jul 22 13:53:38.773063 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.772960 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380"} err="failed to get container status \"d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380\": rpc error: code = NotFound desc = could not find container \"d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380\": container with ID starting with d6b1d696cc30ce405c3ea1e68d2569f0799be2b862943739012a1547aa914380 not found: ID does not exist" Jul 22 13:53:38.785495 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.785469 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prm4m"] Jul 22 13:53:38.791419 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:38.791398 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prm4m"] Jul 22 13:53:39.821345 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:39.821305 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" path="/var/lib/kubelet/pods/9c11a6f6-fbbb-4fa0-8451-74c97f4cc950/volumes" Jul 22 13:53:46.035031 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:46.034992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:46.035595 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:46.035062 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:46.058800 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:46.058766 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:46.828219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:46.828190 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6tscq" Jul 22 13:53:50.343941 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.343891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv"] Jul 22 13:53:50.344327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.344219 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" containerName="registry-server" Jul 22 13:53:50.344327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.344230 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" containerName="registry-server" Jul 22 13:53:50.344327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.344289 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c11a6f6-fbbb-4fa0-8451-74c97f4cc950" containerName="registry-server" Jul 22 13:53:50.348643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.348626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.350963 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.350933 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-grkm9\"" Jul 22 13:53:50.357057 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.357036 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv"] Jul 22 13:53:50.452194 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.452152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4l7d\" (UniqueName: \"kubernetes.io/projected/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-kube-api-access-d4l7d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.452373 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.452219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.452373 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.452239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.553559 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.553515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4l7d\" (UniqueName: \"kubernetes.io/projected/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-kube-api-access-d4l7d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.553731 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.553597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.553731 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.553617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.554042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.554023 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.554084 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.554032 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.562786 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.562758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4l7d\" (UniqueName: \"kubernetes.io/projected/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-kube-api-access-d4l7d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.658168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.658067 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:50.827902 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:50.827877 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv"] Jul 22 13:53:50.829740 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:53:50.829715 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66b2fa4_eb34_4f77_8c3b_a2cea1684093.slice/crio-80b463e6ec4d61ccd304d16a4c29e142552b1811b16a5807b370a683462f027d WatchSource:0}: Error finding container 80b463e6ec4d61ccd304d16a4c29e142552b1811b16a5807b370a683462f027d: Status 404 returned error can't find the container with id 80b463e6ec4d61ccd304d16a4c29e142552b1811b16a5807b370a683462f027d Jul 22 13:53:51.148997 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.148963 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj"] Jul 22 13:53:51.152351 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.152334 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.162287 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.162260 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj"] Jul 22 13:53:51.260253 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.260157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkr8\" (UniqueName: \"kubernetes.io/projected/03b8af70-366c-4595-a758-7fb566898302-kube-api-access-2dkr8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.260253 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.260228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.260453 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.260287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.361482 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.361442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkr8\" (UniqueName: \"kubernetes.io/projected/03b8af70-366c-4595-a758-7fb566898302-kube-api-access-2dkr8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.361988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.361511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.361988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.361545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.361988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.361890 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.361988 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.361976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.373224 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.373195 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkr8\" (UniqueName: \"kubernetes.io/projected/03b8af70-366c-4595-a758-7fb566898302-kube-api-access-2dkr8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.462070 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.462016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:51.546410 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.546379 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz"] Jul 22 13:53:51.551615 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.551590 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.560269 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.559845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz"] Jul 22 13:53:51.603937 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.602550 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj"] Jul 22 13:53:51.607282 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:53:51.607260 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b8af70_366c_4595_a758_7fb566898302.slice/crio-e4bd3219d07ec14aa7e3736895e9bf370dcaf29c56c7c628f3775990ee151959 WatchSource:0}: Error finding container e4bd3219d07ec14aa7e3736895e9bf370dcaf29c56c7c628f3775990ee151959: Status 404 returned error can't find the container with id e4bd3219d07ec14aa7e3736895e9bf370dcaf29c56c7c628f3775990ee151959 Jul 22 13:53:51.664176 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.664151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.664286 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.664234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.664286 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.664266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlp75\" (UniqueName: \"kubernetes.io/projected/ac8826b5-834d-4ebe-93cc-70871f971825-kube-api-access-zlp75\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.765261 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.765225 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.765443 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.765298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlp75\" (UniqueName: \"kubernetes.io/projected/ac8826b5-834d-4ebe-93cc-70871f971825-kube-api-access-zlp75\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.765443 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.765375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.765635 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.765614 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.765677 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.765657 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.777449 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.777426 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlp75\" (UniqueName: \"kubernetes.io/projected/ac8826b5-834d-4ebe-93cc-70871f971825-kube-api-access-zlp75\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.830717 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.830642 2556 generic.go:356] "Generic (PLEG): container finished" podID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerID="b99b4440c1a260d1df5daa8287cb04293aecded6fd83dda92f47ad53146e9ed0" exitCode=0 Jul 22 13:53:51.830858 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.830718 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" event={"ID":"c66b2fa4-eb34-4f77-8c3b-a2cea1684093","Type":"ContainerDied","Data":"b99b4440c1a260d1df5daa8287cb04293aecded6fd83dda92f47ad53146e9ed0"} Jul 22 13:53:51.830858 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.830761 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" event={"ID":"c66b2fa4-eb34-4f77-8c3b-a2cea1684093","Type":"ContainerStarted","Data":"80b463e6ec4d61ccd304d16a4c29e142552b1811b16a5807b370a683462f027d"} Jul 22 13:53:51.832269 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.832244 2556 generic.go:356] "Generic (PLEG): container finished" podID="03b8af70-366c-4595-a758-7fb566898302" containerID="ca2a993f252301206f2a7b6b8a7d711b40032960f4136b4fb853e3a2600cb5bc" exitCode=0 Jul 22 13:53:51.832361 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.832285 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" event={"ID":"03b8af70-366c-4595-a758-7fb566898302","Type":"ContainerDied","Data":"ca2a993f252301206f2a7b6b8a7d711b40032960f4136b4fb853e3a2600cb5bc"} Jul 22 13:53:51.832361 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.832319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" event={"ID":"03b8af70-366c-4595-a758-7fb566898302","Type":"ContainerStarted","Data":"e4bd3219d07ec14aa7e3736895e9bf370dcaf29c56c7c628f3775990ee151959"} Jul 22 13:53:51.862403 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.862377 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:51.946758 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.946724 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw"] Jul 22 13:53:51.951516 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.951489 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:51.963745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:51.962029 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw"] Jul 22 13:53:52.016423 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.016373 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz"] Jul 22 13:53:52.018799 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:53:52.018770 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8826b5_834d_4ebe_93cc_70871f971825.slice/crio-42c392cfc006d053c76440712344acb6b8b1218b121ea152cf9283c23fd7255d WatchSource:0}: Error finding container 42c392cfc006d053c76440712344acb6b8b1218b121ea152cf9283c23fd7255d: Status 404 returned error can't find the container with id 42c392cfc006d053c76440712344acb6b8b1218b121ea152cf9283c23fd7255d Jul 22 13:53:52.067976 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.067943 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.068135 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.068002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mktnx\" (UniqueName: \"kubernetes.io/projected/248c8530-de2d-4f90-abd7-a4db48316a34-kube-api-access-mktnx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.068135 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.068049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.169381 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.169348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.169381 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.169390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mktnx\" (UniqueName: \"kubernetes.io/projected/248c8530-de2d-4f90-abd7-a4db48316a34-kube-api-access-mktnx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.169582 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.169418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.169740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.169726 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.169816 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.169796 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.177515 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.177485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mktnx\" (UniqueName: \"kubernetes.io/projected/248c8530-de2d-4f90-abd7-a4db48316a34-kube-api-access-mktnx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.267704 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.267669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:52.405657 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.405629 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw"] Jul 22 13:53:52.408332 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:53:52.408293 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248c8530_de2d_4f90_abd7_a4db48316a34.slice/crio-d5889c124b23c4689e2e6d9b3defdfcebb609816b8d5b4526446cb979fa5959d WatchSource:0}: Error finding container d5889c124b23c4689e2e6d9b3defdfcebb609816b8d5b4526446cb979fa5959d: Status 404 returned error can't find the container with id d5889c124b23c4689e2e6d9b3defdfcebb609816b8d5b4526446cb979fa5959d Jul 22 13:53:52.838469 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.838428 2556 generic.go:356] "Generic (PLEG): container finished" podID="248c8530-de2d-4f90-abd7-a4db48316a34" containerID="be965830a8e8851adad78c18b133996023f163e54fa7cc044eebeacc360e451e" exitCode=0 Jul 22 13:53:52.838609 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.838517 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" event={"ID":"248c8530-de2d-4f90-abd7-a4db48316a34","Type":"ContainerDied","Data":"be965830a8e8851adad78c18b133996023f163e54fa7cc044eebeacc360e451e"} Jul 22 13:53:52.838609 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.838568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" event={"ID":"248c8530-de2d-4f90-abd7-a4db48316a34","Type":"ContainerStarted","Data":"d5889c124b23c4689e2e6d9b3defdfcebb609816b8d5b4526446cb979fa5959d"} Jul 22 13:53:52.840297 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.840279 2556 generic.go:356] "Generic (PLEG): container finished" podID="03b8af70-366c-4595-a758-7fb566898302" containerID="61317340a64b76e73808ac500439b0ae74c9cafe02b84170ea265e47b32d8a33" exitCode=0 Jul 22 13:53:52.840379 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.840355 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" event={"ID":"03b8af70-366c-4595-a758-7fb566898302","Type":"ContainerDied","Data":"61317340a64b76e73808ac500439b0ae74c9cafe02b84170ea265e47b32d8a33"} Jul 22 13:53:52.841927 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.841892 2556 generic.go:356] "Generic (PLEG): container finished" podID="ac8826b5-834d-4ebe-93cc-70871f971825" containerID="1565ada2fbd884184ee12c3fa71e836575703ea90ff28bce02adab2751c78169" exitCode=0 Jul 22 13:53:52.842025 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.841975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" event={"ID":"ac8826b5-834d-4ebe-93cc-70871f971825","Type":"ContainerDied","Data":"1565ada2fbd884184ee12c3fa71e836575703ea90ff28bce02adab2751c78169"} Jul 22 13:53:52.842086 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:52.842032 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" event={"ID":"ac8826b5-834d-4ebe-93cc-70871f971825","Type":"ContainerStarted","Data":"42c392cfc006d053c76440712344acb6b8b1218b121ea152cf9283c23fd7255d"} Jul 22 13:53:53.848989 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:53.848963 2556 generic.go:356] "Generic (PLEG): container finished" podID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerID="404405112ae1bcca294b63b88179076892f4ae7a0c5022803db7e65db03f6a78" exitCode=0 Jul 22 13:53:53.849459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:53.849060 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" event={"ID":"c66b2fa4-eb34-4f77-8c3b-a2cea1684093","Type":"ContainerDied","Data":"404405112ae1bcca294b63b88179076892f4ae7a0c5022803db7e65db03f6a78"} Jul 22 13:53:53.850952 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:53.850900 2556 generic.go:356] "Generic (PLEG): container finished" podID="248c8530-de2d-4f90-abd7-a4db48316a34" containerID="48180f2de94c945eac8f158f19d353ccbe29b0a8c3b368caecddefb155f9dec3" exitCode=0 Jul 22 13:53:53.851024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:53.851003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" event={"ID":"248c8530-de2d-4f90-abd7-a4db48316a34","Type":"ContainerDied","Data":"48180f2de94c945eac8f158f19d353ccbe29b0a8c3b368caecddefb155f9dec3"} Jul 22 13:53:53.853332 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:53.853311 2556 generic.go:356] "Generic (PLEG): container finished" podID="03b8af70-366c-4595-a758-7fb566898302" containerID="738f72e0f472c7efcc396f17d461d2bbfebe038319958a6750b8d62b35915e7a" exitCode=0 Jul 22 13:53:53.853434 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:53.853347 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" event={"ID":"03b8af70-366c-4595-a758-7fb566898302","Type":"ContainerDied","Data":"738f72e0f472c7efcc396f17d461d2bbfebe038319958a6750b8d62b35915e7a"} Jul 22 13:53:54.860154 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:54.860114 2556 generic.go:356] "Generic (PLEG): container finished" podID="ac8826b5-834d-4ebe-93cc-70871f971825" containerID="43e1fdd2ac5cb31b580bd00be4014ee7a860807ebae74fdc3ad9e8ac189eb2b1" exitCode=0 Jul 22 13:53:54.860602 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:54.860197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" event={"ID":"ac8826b5-834d-4ebe-93cc-70871f971825","Type":"ContainerDied","Data":"43e1fdd2ac5cb31b580bd00be4014ee7a860807ebae74fdc3ad9e8ac189eb2b1"} Jul 22 13:53:54.862606 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:54.862582 2556 generic.go:356] "Generic (PLEG): container finished" podID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerID="57ce3521c2f318f2d0eee18f4fedfa1d69d58bdbd5c9f2c2c723a99da854ed01" exitCode=0 Jul 22 13:53:54.862730 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:54.862678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" event={"ID":"c66b2fa4-eb34-4f77-8c3b-a2cea1684093","Type":"ContainerDied","Data":"57ce3521c2f318f2d0eee18f4fedfa1d69d58bdbd5c9f2c2c723a99da854ed01"} Jul 22 13:53:54.864802 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:54.864782 2556 generic.go:356] "Generic (PLEG): container finished" podID="248c8530-de2d-4f90-abd7-a4db48316a34" containerID="23de55159671cf8633e25f52afef0743fc6d690858dd92b3907cd57f20f5bef7" exitCode=0 Jul 22 13:53:54.864924 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:54.864864 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" event={"ID":"248c8530-de2d-4f90-abd7-a4db48316a34","Type":"ContainerDied","Data":"23de55159671cf8633e25f52afef0743fc6d690858dd92b3907cd57f20f5bef7"} Jul 22 13:53:55.054083 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.054055 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:55.097212 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.097182 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-bundle\") pod \"03b8af70-366c-4595-a758-7fb566898302\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " Jul 22 13:53:55.097401 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.097229 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dkr8\" (UniqueName: \"kubernetes.io/projected/03b8af70-366c-4595-a758-7fb566898302-kube-api-access-2dkr8\") pod \"03b8af70-366c-4595-a758-7fb566898302\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " Jul 22 13:53:55.097401 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.097266 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-util\") pod \"03b8af70-366c-4595-a758-7fb566898302\" (UID: \"03b8af70-366c-4595-a758-7fb566898302\") " Jul 22 13:53:55.097764 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.097736 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-bundle" (OuterVolumeSpecName: "bundle") pod "03b8af70-366c-4595-a758-7fb566898302" (UID: "03b8af70-366c-4595-a758-7fb566898302"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:55.099362 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.099337 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b8af70-366c-4595-a758-7fb566898302-kube-api-access-2dkr8" (OuterVolumeSpecName: "kube-api-access-2dkr8") pod "03b8af70-366c-4595-a758-7fb566898302" (UID: "03b8af70-366c-4595-a758-7fb566898302"). InnerVolumeSpecName "kube-api-access-2dkr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:53:55.102987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.102953 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-util" (OuterVolumeSpecName: "util") pod "03b8af70-366c-4595-a758-7fb566898302" (UID: "03b8af70-366c-4595-a758-7fb566898302"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:55.198808 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.198735 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:55.198808 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.198761 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dkr8\" (UniqueName: \"kubernetes.io/projected/03b8af70-366c-4595-a758-7fb566898302-kube-api-access-2dkr8\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:55.198808 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.198772 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03b8af70-366c-4595-a758-7fb566898302-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:55.871684 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.871656 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" Jul 22 13:53:55.872117 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.871648 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj" event={"ID":"03b8af70-366c-4595-a758-7fb566898302","Type":"ContainerDied","Data":"e4bd3219d07ec14aa7e3736895e9bf370dcaf29c56c7c628f3775990ee151959"} Jul 22 13:53:55.872117 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.871777 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4bd3219d07ec14aa7e3736895e9bf370dcaf29c56c7c628f3775990ee151959" Jul 22 13:53:55.874020 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.873994 2556 generic.go:356] "Generic (PLEG): container finished" podID="ac8826b5-834d-4ebe-93cc-70871f971825" containerID="29d0e4b4942ff46ec7d34e7640e4b367208ab7a8bcc255a94110ca8eafcabfff" exitCode=0 Jul 22 13:53:55.874123 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:55.874019 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" event={"ID":"ac8826b5-834d-4ebe-93cc-70871f971825","Type":"ContainerDied","Data":"29d0e4b4942ff46ec7d34e7640e4b367208ab7a8bcc255a94110ca8eafcabfff"} Jul 22 13:53:56.002651 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.002629 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:56.033461 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.033439 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:56.107454 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.107424 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-bundle\") pod \"248c8530-de2d-4f90-abd7-a4db48316a34\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " Jul 22 13:53:56.107635 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.107467 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-util\") pod \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " Jul 22 13:53:56.107635 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.107503 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-bundle\") pod \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " Jul 22 13:53:56.107635 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.107541 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-util\") pod \"248c8530-de2d-4f90-abd7-a4db48316a34\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " Jul 22 13:53:56.107635 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.107620 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mktnx\" (UniqueName: \"kubernetes.io/projected/248c8530-de2d-4f90-abd7-a4db48316a34-kube-api-access-mktnx\") pod \"248c8530-de2d-4f90-abd7-a4db48316a34\" (UID: \"248c8530-de2d-4f90-abd7-a4db48316a34\") " Jul 22 13:53:56.107864 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.107652 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4l7d\" (UniqueName: \"kubernetes.io/projected/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-kube-api-access-d4l7d\") pod \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\" (UID: \"c66b2fa4-eb34-4f77-8c3b-a2cea1684093\") " Jul 22 13:53:56.108111 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.108086 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-bundle" (OuterVolumeSpecName: "bundle") pod "c66b2fa4-eb34-4f77-8c3b-a2cea1684093" (UID: "c66b2fa4-eb34-4f77-8c3b-a2cea1684093"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:56.108225 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.108191 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-bundle" (OuterVolumeSpecName: "bundle") pod "248c8530-de2d-4f90-abd7-a4db48316a34" (UID: "248c8530-de2d-4f90-abd7-a4db48316a34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:56.109835 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.109811 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/248c8530-de2d-4f90-abd7-a4db48316a34-kube-api-access-mktnx" (OuterVolumeSpecName: "kube-api-access-mktnx") pod "248c8530-de2d-4f90-abd7-a4db48316a34" (UID: "248c8530-de2d-4f90-abd7-a4db48316a34"). InnerVolumeSpecName "kube-api-access-mktnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:53:56.110047 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.110027 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-kube-api-access-d4l7d" (OuterVolumeSpecName: "kube-api-access-d4l7d") pod "c66b2fa4-eb34-4f77-8c3b-a2cea1684093" (UID: "c66b2fa4-eb34-4f77-8c3b-a2cea1684093"). InnerVolumeSpecName "kube-api-access-d4l7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:53:56.116499 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.116471 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-util" (OuterVolumeSpecName: "util") pod "248c8530-de2d-4f90-abd7-a4db48316a34" (UID: "248c8530-de2d-4f90-abd7-a4db48316a34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:56.116654 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.116637 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-util" (OuterVolumeSpecName: "util") pod "c66b2fa4-eb34-4f77-8c3b-a2cea1684093" (UID: "c66b2fa4-eb34-4f77-8c3b-a2cea1684093"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:56.208343 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.208317 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:56.208343 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.208340 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:56.208343 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.208358 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:56.208566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.208366 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248c8530-de2d-4f90-abd7-a4db48316a34-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:56.208566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.208374 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mktnx\" (UniqueName: \"kubernetes.io/projected/248c8530-de2d-4f90-abd7-a4db48316a34-kube-api-access-mktnx\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:56.208566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.208384 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4l7d\" (UniqueName: \"kubernetes.io/projected/c66b2fa4-eb34-4f77-8c3b-a2cea1684093-kube-api-access-d4l7d\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:56.881383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.881359 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" Jul 22 13:53:56.881800 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.881359 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv" event={"ID":"c66b2fa4-eb34-4f77-8c3b-a2cea1684093","Type":"ContainerDied","Data":"80b463e6ec4d61ccd304d16a4c29e142552b1811b16a5807b370a683462f027d"} Jul 22 13:53:56.881800 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.881489 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80b463e6ec4d61ccd304d16a4c29e142552b1811b16a5807b370a683462f027d" Jul 22 13:53:56.883345 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.883323 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" Jul 22 13:53:56.883345 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.883341 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw" event={"ID":"248c8530-de2d-4f90-abd7-a4db48316a34","Type":"ContainerDied","Data":"d5889c124b23c4689e2e6d9b3defdfcebb609816b8d5b4526446cb979fa5959d"} Jul 22 13:53:56.883507 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:56.883373 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5889c124b23c4689e2e6d9b3defdfcebb609816b8d5b4526446cb979fa5959d" Jul 22 13:53:57.020041 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.020016 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:57.116118 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.116084 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-bundle\") pod \"ac8826b5-834d-4ebe-93cc-70871f971825\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " Jul 22 13:53:57.116271 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.116137 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-util\") pod \"ac8826b5-834d-4ebe-93cc-70871f971825\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " Jul 22 13:53:57.116271 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.116156 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlp75\" (UniqueName: \"kubernetes.io/projected/ac8826b5-834d-4ebe-93cc-70871f971825-kube-api-access-zlp75\") pod \"ac8826b5-834d-4ebe-93cc-70871f971825\" (UID: \"ac8826b5-834d-4ebe-93cc-70871f971825\") " Jul 22 13:53:57.116542 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.116512 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-bundle" (OuterVolumeSpecName: "bundle") pod "ac8826b5-834d-4ebe-93cc-70871f971825" (UID: "ac8826b5-834d-4ebe-93cc-70871f971825"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:57.118301 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.118273 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8826b5-834d-4ebe-93cc-70871f971825-kube-api-access-zlp75" (OuterVolumeSpecName: "kube-api-access-zlp75") pod "ac8826b5-834d-4ebe-93cc-70871f971825" (UID: "ac8826b5-834d-4ebe-93cc-70871f971825"). InnerVolumeSpecName "kube-api-access-zlp75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:53:57.121421 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.121394 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-util" (OuterVolumeSpecName: "util") pod "ac8826b5-834d-4ebe-93cc-70871f971825" (UID: "ac8826b5-834d-4ebe-93cc-70871f971825"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:53:57.217645 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.217567 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-bundle\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:57.217645 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.217594 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac8826b5-834d-4ebe-93cc-70871f971825-util\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:57.217645 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.217608 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlp75\" (UniqueName: \"kubernetes.io/projected/ac8826b5-834d-4ebe-93cc-70871f971825-kube-api-access-zlp75\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:53:57.889945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.889894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" event={"ID":"ac8826b5-834d-4ebe-93cc-70871f971825","Type":"ContainerDied","Data":"42c392cfc006d053c76440712344acb6b8b1218b121ea152cf9283c23fd7255d"} Jul 22 13:53:57.889945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.889947 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz" Jul 22 13:53:57.890360 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:53:57.889965 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42c392cfc006d053c76440712344acb6b8b1218b121ea152cf9283c23fd7255d" Jul 22 13:54:03.975690 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:03.975654 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:06.623256 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623216 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6"] Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623528 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="util" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623539 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="util" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623548 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623554 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623563 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623568 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623578 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623584 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623592 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623597 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623604 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="util" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623608 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="util" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623615 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623620 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623625 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623629 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623635 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623640 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="pull" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623647 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="extract" Jul 22 13:54:06.623643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623652 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="extract" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623663 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="util" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623668 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="util" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623674 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="util" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623678 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="util" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623726 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="248c8530-de2d-4f90-abd7-a4db48316a34" containerName="extract" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623734 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8826b5-834d-4ebe-93cc-70871f971825" containerName="extract" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623741 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b8af70-366c-4595-a758-7fb566898302" containerName="extract" Jul 22 13:54:06.624223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.623748 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c66b2fa4-eb34-4f77-8c3b-a2cea1684093" containerName="extract" Jul 22 13:54:06.629787 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.629768 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:06.632741 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.632718 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xx5jq\"" Jul 22 13:54:06.633274 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.633258 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 22 13:54:06.645770 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.645742 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6"] Jul 22 13:54:06.697486 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.697447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpgbj\" (UniqueName: \"kubernetes.io/projected/f716ed13-72f0-42c4-b859-8b406f0b4a9f-kube-api-access-dpgbj\") pod \"dns-operator-controller-manager-864dd78c4c-sq7s6\" (UID: \"f716ed13-72f0-42c4-b859-8b406f0b4a9f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:06.798391 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.798345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpgbj\" (UniqueName: \"kubernetes.io/projected/f716ed13-72f0-42c4-b859-8b406f0b4a9f-kube-api-access-dpgbj\") pod \"dns-operator-controller-manager-864dd78c4c-sq7s6\" (UID: \"f716ed13-72f0-42c4-b859-8b406f0b4a9f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:06.810275 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.810249 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpgbj\" (UniqueName: \"kubernetes.io/projected/f716ed13-72f0-42c4-b859-8b406f0b4a9f-kube-api-access-dpgbj\") pod \"dns-operator-controller-manager-864dd78c4c-sq7s6\" (UID: \"f716ed13-72f0-42c4-b859-8b406f0b4a9f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:06.940528 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:06.940430 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:07.116162 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:07.116139 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6"] Jul 22 13:54:07.118009 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:54:07.117978 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf716ed13_72f0_42c4_b859_8b406f0b4a9f.slice/crio-3ffd4633db691179c3505294baabe280fba22df0e03afd97499ce3bf250b32fa WatchSource:0}: Error finding container 3ffd4633db691179c3505294baabe280fba22df0e03afd97499ce3bf250b32fa: Status 404 returned error can't find the container with id 3ffd4633db691179c3505294baabe280fba22df0e03afd97499ce3bf250b32fa Jul 22 13:54:07.561298 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:07.561241 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:07.942696 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:07.942665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" event={"ID":"f716ed13-72f0-42c4-b859-8b406f0b4a9f","Type":"ContainerStarted","Data":"3ffd4633db691179c3505294baabe280fba22df0e03afd97499ce3bf250b32fa"} Jul 22 13:54:09.955533 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:09.955491 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" event={"ID":"f716ed13-72f0-42c4-b859-8b406f0b4a9f","Type":"ContainerStarted","Data":"602b7894e27ba7a488c85771d596cb2c3492da17fd2277c1ba27117f1ba6e496"} Jul 22 13:54:09.956027 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:09.955619 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:09.990363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:09.990309 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" podStartSLOduration=1.958508742 podStartE2EDuration="3.990293977s" totalImagesPullingTime="2.031785235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:09.987872572 +0000 UTC m=+476.637888612" watchObservedRunningTime="2026-07-22 13:54:09.990293977 +0000 UTC m=+476.640310017" Jul 22 13:54:10.611793 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:10.611760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:12.111056 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.111008 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:12.168825 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.168790 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz"] Jul 22 13:54:12.174225 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.174200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.176831 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.176806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcrqc\"" Jul 22 13:54:12.188213 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.188179 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz"] Jul 22 13:54:12.250849 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.250814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz5l6\" (UniqueName: \"kubernetes.io/projected/ac285956-c48a-4e39-936d-a1472508312d-kube-api-access-bz5l6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.251073 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.251004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac285956-c48a-4e39-936d-a1472508312d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.352287 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.352244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac285956-c48a-4e39-936d-a1472508312d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.352287 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.352295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz5l6\" (UniqueName: \"kubernetes.io/projected/ac285956-c48a-4e39-936d-a1472508312d-kube-api-access-bz5l6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.352680 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.352657 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac285956-c48a-4e39-936d-a1472508312d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.368266 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.368191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz5l6\" (UniqueName: \"kubernetes.io/projected/ac285956-c48a-4e39-936d-a1472508312d-kube-api-access-bz5l6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.371297 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.371265 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:12.484253 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.484214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:12.634311 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.634285 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz"] Jul 22 13:54:12.637211 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:54:12.637162 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac285956_c48a_4e39_936d_a1472508312d.slice/crio-035e492891c0841fa3b2a1fa62105be63df6c646377ec6bc334198c486fb33c0 WatchSource:0}: Error finding container 035e492891c0841fa3b2a1fa62105be63df6c646377ec6bc334198c486fb33c0: Status 404 returned error can't find the container with id 035e492891c0841fa3b2a1fa62105be63df6c646377ec6bc334198c486fb33c0 Jul 22 13:54:12.971968 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.971862 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" event={"ID":"ac285956-c48a-4e39-936d-a1472508312d","Type":"ContainerStarted","Data":"035e492891c0841fa3b2a1fa62105be63df6c646377ec6bc334198c486fb33c0"} Jul 22 13:54:12.981558 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:12.981536 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:13.728759 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:13.728730 2556 scope.go:117] "RemoveContainer" containerID="66d80fe8da6fe0cdeae287e041acfc648d7d505778b07734c28c67eabd8ffb4c" Jul 22 13:54:15.442216 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:15.442182 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:15.547119 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:15.547086 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:16.367225 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:16.367185 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:18.002205 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.002161 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" event={"ID":"ac285956-c48a-4e39-936d-a1472508312d","Type":"ContainerStarted","Data":"666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537"} Jul 22 13:54:18.002707 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.002290 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:18.026128 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.026019 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" podStartSLOduration=0.907855033 podStartE2EDuration="6.026002108s" totalImagesPullingTime="5.118147075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:18.025440038 +0000 UTC m=+484.675456077" watchObservedRunningTime="2026-07-22 13:54:18.026002108 +0000 UTC m=+484.676018202" Jul 22 13:54:18.212142 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.212102 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7"] Jul 22 13:54:18.215818 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.215785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:18.223294 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.223263 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-p2tlt\"" Jul 22 13:54:18.227843 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.227819 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7"] Jul 22 13:54:18.230490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.230455 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:18.306441 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.306349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f66g\" (UniqueName: \"kubernetes.io/projected/e5cbc387-9550-4324-bea1-eb08e02e02a0-kube-api-access-5f66g\") pod \"limitador-operator-controller-manager-859d7b78bd-7djn7\" (UID: \"e5cbc387-9550-4324-bea1-eb08e02e02a0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:18.407489 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.407440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f66g\" (UniqueName: \"kubernetes.io/projected/e5cbc387-9550-4324-bea1-eb08e02e02a0-kube-api-access-5f66g\") pod \"limitador-operator-controller-manager-859d7b78bd-7djn7\" (UID: \"e5cbc387-9550-4324-bea1-eb08e02e02a0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:18.419594 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.419559 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f66g\" (UniqueName: \"kubernetes.io/projected/e5cbc387-9550-4324-bea1-eb08e02e02a0-kube-api-access-5f66g\") pod \"limitador-operator-controller-manager-859d7b78bd-7djn7\" (UID: \"e5cbc387-9550-4324-bea1-eb08e02e02a0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:18.526669 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.526626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:18.671032 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:18.670902 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7"] Jul 22 13:54:18.673860 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:54:18.673831 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cbc387_9550_4324_bea1_eb08e02e02a0.slice/crio-fed03f772eb75a7ac6efc88cd0579b58ee4e6831bc3f2d074c6c4a8a2d792815 WatchSource:0}: Error finding container fed03f772eb75a7ac6efc88cd0579b58ee4e6831bc3f2d074c6c4a8a2d792815: Status 404 returned error can't find the container with id fed03f772eb75a7ac6efc88cd0579b58ee4e6831bc3f2d074c6c4a8a2d792815 Jul 22 13:54:19.008212 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:19.008177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" event={"ID":"e5cbc387-9550-4324-bea1-eb08e02e02a0","Type":"ContainerStarted","Data":"fed03f772eb75a7ac6efc88cd0579b58ee4e6831bc3f2d074c6c4a8a2d792815"} Jul 22 13:54:19.798375 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:19.798343 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:19.901367 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:19.901330 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:20.753548 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:20.753436 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:20.853611 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:20.853568 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:20.962781 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:20.962752 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-sq7s6" Jul 22 13:54:21.019997 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:21.019895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" event={"ID":"e5cbc387-9550-4324-bea1-eb08e02e02a0","Type":"ContainerStarted","Data":"5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984"} Jul 22 13:54:21.020144 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:21.020024 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:21.040083 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:21.040039 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" podStartSLOduration=1.359794734 podStartE2EDuration="3.040023126s" totalImagesPullingTime="1.680228392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:21.039209762 +0000 UTC m=+487.689225823" watchObservedRunningTime="2026-07-22 13:54:21.040023126 +0000 UTC m=+487.690039165" Jul 22 13:54:22.387107 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:22.387069 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:22.488436 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:22.488399 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:23.577483 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:23.577448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:23.659294 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:23.659265 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:24.346219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:24.346185 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:24.450059 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:24.450026 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:29.010534 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:29.010507 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:30.978662 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:30.978631 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz"] Jul 22 13:54:30.979150 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:30.978806 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" podUID="ac285956-c48a-4e39-936d-a1472508312d" containerName="manager" containerID="cri-o://666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537" gracePeriod=2 Jul 22 13:54:30.981899 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:30.981858 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:30.983987 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:30.983964 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz"] Jul 22 13:54:30.996823 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:30.996799 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7"] Jul 22 13:54:30.997267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:30.997023 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" containerName="manager" containerID="cri-o://5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984" gracePeriod=2 Jul 22 13:54:31.000989 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.000730 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.000989 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.000884 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.001779 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.001708 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7"] Jul 22 13:54:31.003236 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.003210 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7djn7\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.007041 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.006670 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.008168 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008148 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll"] Jul 22 13:54:31.008478 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008466 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac285956-c48a-4e39-936d-a1472508312d" containerName="manager" Jul 22 13:54:31.008522 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008481 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac285956-c48a-4e39-936d-a1472508312d" containerName="manager" Jul 22 13:54:31.008522 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008498 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" containerName="manager" Jul 22 13:54:31.008522 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008504 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" containerName="manager" Jul 22 13:54:31.008612 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008582 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" containerName="manager" Jul 22 13:54:31.008612 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.008592 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac285956-c48a-4e39-936d-a1472508312d" containerName="manager" Jul 22 13:54:31.009939 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.009895 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7djn7\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.011653 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.011637 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.016864 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.016845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkcd8\" (UniqueName: \"kubernetes.io/projected/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-kube-api-access-qkcd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4pll\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.016992 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.016974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4pll\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.031969 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.031890 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl"] Jul 22 13:54:31.035781 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.035761 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll"] Jul 22 13:54:31.035890 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.035851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:31.057223 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.057180 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl"] Jul 22 13:54:31.065037 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.065002 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.066671 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.066644 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7djn7\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.068439 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.068413 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7djn7\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.088665 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.088636 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.118065 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.118033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkcd8\" (UniqueName: \"kubernetes.io/projected/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-kube-api-access-qkcd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4pll\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.118228 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.118090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpvf\" (UniqueName: \"kubernetes.io/projected/c2a4f266-84ea-417d-9378-6786caeefcda-kube-api-access-fbpvf\") pod \"limitador-operator-controller-manager-859d7b78bd-jt5hl\" (UID: \"c2a4f266-84ea-417d-9378-6786caeefcda\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:31.118228 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.118165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4pll\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.118647 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.118622 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4pll\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.129696 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.129667 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkcd8\" (UniqueName: \"kubernetes.io/projected/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-kube-api-access-qkcd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4pll\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.219475 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.219442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpvf\" (UniqueName: \"kubernetes.io/projected/c2a4f266-84ea-417d-9378-6786caeefcda-kube-api-access-fbpvf\") pod \"limitador-operator-controller-manager-859d7b78bd-jt5hl\" (UID: \"c2a4f266-84ea-417d-9378-6786caeefcda\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:31.227498 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.227476 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpvf\" (UniqueName: \"kubernetes.io/projected/c2a4f266-84ea-417d-9378-6786caeefcda-kube-api-access-fbpvf\") pod \"limitador-operator-controller-manager-859d7b78bd-jt5hl\" (UID: \"c2a4f266-84ea-417d-9378-6786caeefcda\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:31.243805 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.243788 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.245606 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.245578 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.245882 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.245867 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.247102 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.247082 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7djn7\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.248586 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.248566 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7fcz\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="ac285956-c48a-4e39-936d-a1472508312d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:31.250027 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:31.250006 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7djn7\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:31.320078 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.320057 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac285956-c48a-4e39-936d-a1472508312d-extensions-socket-volume\") pod \"ac285956-c48a-4e39-936d-a1472508312d\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " Jul 22 13:54:31.320235 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.320104 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f66g\" (UniqueName: \"kubernetes.io/projected/e5cbc387-9550-4324-bea1-eb08e02e02a0-kube-api-access-5f66g\") pod \"e5cbc387-9550-4324-bea1-eb08e02e02a0\" (UID: \"e5cbc387-9550-4324-bea1-eb08e02e02a0\") " Jul 22 13:54:31.320235 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.320123 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz5l6\" (UniqueName: \"kubernetes.io/projected/ac285956-c48a-4e39-936d-a1472508312d-kube-api-access-bz5l6\") pod \"ac285956-c48a-4e39-936d-a1472508312d\" (UID: \"ac285956-c48a-4e39-936d-a1472508312d\") " Jul 22 13:54:31.320533 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.320509 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac285956-c48a-4e39-936d-a1472508312d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac285956-c48a-4e39-936d-a1472508312d" (UID: "ac285956-c48a-4e39-936d-a1472508312d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:54:31.322170 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.322149 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cbc387-9550-4324-bea1-eb08e02e02a0-kube-api-access-5f66g" (OuterVolumeSpecName: "kube-api-access-5f66g") pod "e5cbc387-9550-4324-bea1-eb08e02e02a0" (UID: "e5cbc387-9550-4324-bea1-eb08e02e02a0"). InnerVolumeSpecName "kube-api-access-5f66g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:54:31.322282 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.322266 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac285956-c48a-4e39-936d-a1472508312d-kube-api-access-bz5l6" (OuterVolumeSpecName: "kube-api-access-bz5l6") pod "ac285956-c48a-4e39-936d-a1472508312d" (UID: "ac285956-c48a-4e39-936d-a1472508312d"). InnerVolumeSpecName "kube-api-access-bz5l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:54:31.421054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.421031 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f66g\" (UniqueName: \"kubernetes.io/projected/e5cbc387-9550-4324-bea1-eb08e02e02a0-kube-api-access-5f66g\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:54:31.421054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.421054 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz5l6\" (UniqueName: \"kubernetes.io/projected/ac285956-c48a-4e39-936d-a1472508312d-kube-api-access-bz5l6\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:54:31.421054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.421065 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac285956-c48a-4e39-936d-a1472508312d-extensions-socket-volume\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:54:31.429976 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.429954 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:31.447986 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.447957 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:31.602970 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.602942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll"] Jul 22 13:54:31.604748 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:54:31.604723 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e73d3d_dd15_46b7_97cb_ae695ebf40e9.slice/crio-c146a8edb39a3d65dd01e14265fafe8e5c426d6001b177e6cee3a0b4e55d25f6 WatchSource:0}: Error finding container c146a8edb39a3d65dd01e14265fafe8e5c426d6001b177e6cee3a0b4e55d25f6: Status 404 returned error can't find the container with id c146a8edb39a3d65dd01e14265fafe8e5c426d6001b177e6cee3a0b4e55d25f6 Jul 22 13:54:31.611695 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.611677 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl"] Jul 22 13:54:31.613154 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:54:31.613133 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a4f266_84ea_417d_9378_6786caeefcda.slice/crio-ecf407cbfce968b1f747dd6c0c372afcab8f0ad489f31ddee34e28964d48193f WatchSource:0}: Error finding container ecf407cbfce968b1f747dd6c0c372afcab8f0ad489f31ddee34e28964d48193f: Status 404 returned error can't find the container with id ecf407cbfce968b1f747dd6c0c372afcab8f0ad489f31ddee34e28964d48193f Jul 22 13:54:31.821332 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.821257 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac285956-c48a-4e39-936d-a1472508312d" path="/var/lib/kubelet/pods/ac285956-c48a-4e39-936d-a1472508312d/volumes" Jul 22 13:54:31.821594 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:31.821581 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cbc387-9550-4324-bea1-eb08e02e02a0" path="/var/lib/kubelet/pods/e5cbc387-9550-4324-bea1-eb08e02e02a0/volumes" Jul 22 13:54:32.067818 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.067781 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:32.075543 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.075476 2556 generic.go:356] "Generic (PLEG): container finished" podID="ac285956-c48a-4e39-936d-a1472508312d" containerID="666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537" exitCode=0 Jul 22 13:54:32.075543 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.075532 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7fcz" Jul 22 13:54:32.075743 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.075569 2556 scope.go:117] "RemoveContainer" containerID="666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537" Jul 22 13:54:32.077008 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.076989 2556 generic.go:356] "Generic (PLEG): container finished" podID="e5cbc387-9550-4324-bea1-eb08e02e02a0" containerID="5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984" exitCode=0 Jul 22 13:54:32.077079 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.077049 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7djn7" Jul 22 13:54:32.079558 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.079535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" event={"ID":"65e73d3d-dd15-46b7-97cb-ae695ebf40e9","Type":"ContainerStarted","Data":"80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3"} Jul 22 13:54:32.079682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.079589 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:32.079682 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.079612 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" event={"ID":"65e73d3d-dd15-46b7-97cb-ae695ebf40e9","Type":"ContainerStarted","Data":"c146a8edb39a3d65dd01e14265fafe8e5c426d6001b177e6cee3a0b4e55d25f6"} Jul 22 13:54:32.081231 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.081211 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" event={"ID":"c2a4f266-84ea-417d-9378-6786caeefcda","Type":"ContainerStarted","Data":"30aaf8adc197cba148cd595085b741bd76a992ace2b526ba3137b5c79f88d04c"} Jul 22 13:54:32.081332 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.081251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" event={"ID":"c2a4f266-84ea-417d-9378-6786caeefcda","Type":"ContainerStarted","Data":"ecf407cbfce968b1f747dd6c0c372afcab8f0ad489f31ddee34e28964d48193f"} Jul 22 13:54:32.081332 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.081296 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:32.085362 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.085348 2556 scope.go:117] "RemoveContainer" containerID="666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537" Jul 22 13:54:32.085590 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:32.085572 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537\": container with ID starting with 666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537 not found: ID does not exist" containerID="666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537" Jul 22 13:54:32.085641 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.085597 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537"} err="failed to get container status \"666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537\": rpc error: code = NotFound desc = could not find container \"666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537\": container with ID starting with 666ce4220c25c5b05bdf602d7b06225a29c5352b4f4a8b0ee1a2c0a64f812537 not found: ID does not exist" Jul 22 13:54:32.085641 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.085612 2556 scope.go:117] "RemoveContainer" containerID="5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984" Jul 22 13:54:32.093155 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.093137 2556 scope.go:117] "RemoveContainer" containerID="5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984" Jul 22 13:54:32.093410 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:32.093391 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984\": container with ID starting with 5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984 not found: ID does not exist" containerID="5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984" Jul 22 13:54:32.093618 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.093430 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984"} err="failed to get container status \"5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984\": rpc error: code = NotFound desc = could not find container \"5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984\": container with ID starting with 5828b31db5c80ecf972da646ce4db1a647e8cc7176636330b4d4a3358a752984 not found: ID does not exist" Jul 22 13:54:32.100315 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.100276 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" podStartSLOduration=2.100265246 podStartE2EDuration="2.100265246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:32.098345187 +0000 UTC m=+498.748361248" watchObservedRunningTime="2026-07-22 13:54:32.100265246 +0000 UTC m=+498.750281286" Jul 22 13:54:32.121608 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.121559 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" podStartSLOduration=1.121543365 podStartE2EDuration="1.121543365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:32.12052872 +0000 UTC m=+498.770544789" watchObservedRunningTime="2026-07-22 13:54:32.121543365 +0000 UTC m=+498.771559405" Jul 22 13:54:32.175537 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:32.175508 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:35.087891 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:35.087855 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:35.223501 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:35.223467 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:37.670426 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:37.670396 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:37.780094 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:37.780057 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:41.495189 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:41.495157 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:41.592348 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:41.592316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:43.090234 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:43.090205 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jt5hl" Jul 22 13:54:43.090641 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:43.090281 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:48.131036 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.130997 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll"] Jul 22 13:54:48.131459 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.131201 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" podUID="65e73d3d-dd15-46b7-97cb-ae695ebf40e9" containerName="manager" containerID="cri-o://80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3" gracePeriod=10 Jul 22 13:54:48.380337 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.380314 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:48.461138 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.461064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-extensions-socket-volume\") pod \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " Jul 22 13:54:48.461287 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.461153 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkcd8\" (UniqueName: \"kubernetes.io/projected/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-kube-api-access-qkcd8\") pod \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\" (UID: \"65e73d3d-dd15-46b7-97cb-ae695ebf40e9\") " Jul 22 13:54:48.461476 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.461455 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65e73d3d-dd15-46b7-97cb-ae695ebf40e9" (UID: "65e73d3d-dd15-46b7-97cb-ae695ebf40e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:54:48.463144 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.463122 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-kube-api-access-qkcd8" (OuterVolumeSpecName: "kube-api-access-qkcd8") pod "65e73d3d-dd15-46b7-97cb-ae695ebf40e9" (UID: "65e73d3d-dd15-46b7-97cb-ae695ebf40e9"). InnerVolumeSpecName "kube-api-access-qkcd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:54:48.562283 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.562249 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-extensions-socket-volume\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:54:48.562283 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:48.562278 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkcd8\" (UniqueName: \"kubernetes.io/projected/65e73d3d-dd15-46b7-97cb-ae695ebf40e9-kube-api-access-qkcd8\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:54:49.173698 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.173662 2556 generic.go:356] "Generic (PLEG): container finished" podID="65e73d3d-dd15-46b7-97cb-ae695ebf40e9" containerID="80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3" exitCode=0 Jul 22 13:54:49.173698 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.173704 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" Jul 22 13:54:49.174266 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.173756 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" event={"ID":"65e73d3d-dd15-46b7-97cb-ae695ebf40e9","Type":"ContainerDied","Data":"80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3"} Jul 22 13:54:49.174266 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.173811 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll" event={"ID":"65e73d3d-dd15-46b7-97cb-ae695ebf40e9","Type":"ContainerDied","Data":"c146a8edb39a3d65dd01e14265fafe8e5c426d6001b177e6cee3a0b4e55d25f6"} Jul 22 13:54:49.174266 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.173832 2556 scope.go:117] "RemoveContainer" containerID="80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3" Jul 22 13:54:49.182729 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.182712 2556 scope.go:117] "RemoveContainer" containerID="80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3" Jul 22 13:54:49.183005 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:54:49.182986 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3\": container with ID starting with 80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3 not found: ID does not exist" containerID="80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3" Jul 22 13:54:49.183074 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.183014 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3"} err="failed to get container status \"80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3\": rpc error: code = NotFound desc = could not find container \"80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3\": container with ID starting with 80c3a5123cf616549b0a88b1b36f38b65f2268803d7cf36177d695996f02b2e3 not found: ID does not exist" Jul 22 13:54:49.195588 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.195563 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll"] Jul 22 13:54:49.204692 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.204670 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4pll"] Jul 22 13:54:49.821609 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:49.821576 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e73d3d-dd15-46b7-97cb-ae695ebf40e9" path="/var/lib/kubelet/pods/65e73d3d-dd15-46b7-97cb-ae695ebf40e9/volumes" Jul 22 13:54:51.482425 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:51.482389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:51.584047 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:51.584012 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:54.457629 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:54.457588 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:54:54.558966 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:54:54.558930 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:04.468649 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.468617 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2"] Jul 22 13:55:04.469042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.468982 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e73d3d-dd15-46b7-97cb-ae695ebf40e9" containerName="manager" Jul 22 13:55:04.469042 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.468993 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e73d3d-dd15-46b7-97cb-ae695ebf40e9" containerName="manager" Jul 22 13:55:04.469134 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.469059 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e73d3d-dd15-46b7-97cb-ae695ebf40e9" containerName="manager" Jul 22 13:55:04.474321 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.474303 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.476267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.476250 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w2nm4\"" Jul 22 13:55:04.486498 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.486471 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2"] Jul 22 13:55:04.506688 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.506655 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:04.596469 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a6de980-514b-4488-8540-18c71b07c46d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596637 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596637 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a6de980-514b-4488-8540-18c71b07c46d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596637 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596561 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a6de980-514b-4488-8540-18c71b07c46d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.596885 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.596752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsktv\" (UniqueName: \"kubernetes.io/projected/5a6de980-514b-4488-8540-18c71b07c46d-kube-api-access-hsktv\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.656428 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.656398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:04.697219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a6de980-514b-4488-8540-18c71b07c46d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697219 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697262 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsktv\" (UniqueName: \"kubernetes.io/projected/5a6de980-514b-4488-8540-18c71b07c46d-kube-api-access-hsktv\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a6de980-514b-4488-8540-18c71b07c46d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697541 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a6de980-514b-4488-8540-18c71b07c46d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697718 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697900 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697843 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.697900 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697883 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.698009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.697956 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.698046 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.698014 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a6de980-514b-4488-8540-18c71b07c46d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.699598 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.699570 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a6de980-514b-4488-8540-18c71b07c46d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.699851 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.699833 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a6de980-514b-4488-8540-18c71b07c46d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.706272 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.706248 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a6de980-514b-4488-8540-18c71b07c46d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.707535 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.707514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsktv\" (UniqueName: \"kubernetes.io/projected/5a6de980-514b-4488-8540-18c71b07c46d-kube-api-access-hsktv\") pod \"maas-default-gateway-openshift-default-56654dcf7-j5mv2\" (UID: \"5a6de980-514b-4488-8540-18c71b07c46d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.784384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.784290 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:04.935286 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.935261 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2"] Jul 22 13:55:04.937169 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:04.937133 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6de980_514b_4488_8540_18c71b07c46d.slice/crio-119f6b36da2a1979dce13b5403ab8806e856c9101f06f8dd2cd35cc4482f3f14 WatchSource:0}: Error finding container 119f6b36da2a1979dce13b5403ab8806e856c9101f06f8dd2cd35cc4482f3f14: Status 404 returned error can't find the container with id 119f6b36da2a1979dce13b5403ab8806e856c9101f06f8dd2cd35cc4482f3f14 Jul 22 13:55:04.939406 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.939365 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:55:04.939497 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.939457 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:55:04.939537 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:04.939497 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:55:05.259229 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.259194 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" event={"ID":"5a6de980-514b-4488-8540-18c71b07c46d","Type":"ContainerStarted","Data":"9838dc8196bee44af681da3e0921f2cfa84646d754c096601f4b99e8d0842377"} Jul 22 13:55:05.259443 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.259287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" event={"ID":"5a6de980-514b-4488-8540-18c71b07c46d","Type":"ContainerStarted","Data":"119f6b36da2a1979dce13b5403ab8806e856c9101f06f8dd2cd35cc4482f3f14"} Jul 22 13:55:05.280919 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.280868 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" podStartSLOduration=1.280851732 podStartE2EDuration="1.280851732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:05.278504742 +0000 UTC m=+531.928520783" watchObservedRunningTime="2026-07-22 13:55:05.280851732 +0000 UTC m=+531.930867772" Jul 22 13:55:05.629986 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.629947 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:05.733340 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.733308 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:05.784504 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.784472 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:05.789187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.789155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:05.817029 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:05.816980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:06.265065 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.265033 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:06.266173 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.266145 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:55:06.269413 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.269382 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:06.273137 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.273110 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.275233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.275211 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 13:55:06.275233 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.275224 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-grkm9\"" Jul 22 13:55:06.276945 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.276922 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:06.280860 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.280835 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:06.373741 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.373706 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:06.402297 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.402267 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:06.415492 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.415458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-config-file\") pod \"limitador-limitador-64c94fd64f-bh8wl\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.415664 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.415507 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvgsd\" (UniqueName: \"kubernetes.io/projected/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-kube-api-access-kvgsd\") pod \"limitador-limitador-64c94fd64f-bh8wl\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.495464 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.495432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:06.516743 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.516656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-config-file\") pod \"limitador-limitador-64c94fd64f-bh8wl\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.516743 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.516697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvgsd\" (UniqueName: \"kubernetes.io/projected/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-kube-api-access-kvgsd\") pod \"limitador-limitador-64c94fd64f-bh8wl\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.517365 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.517344 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-config-file\") pod \"limitador-limitador-64c94fd64f-bh8wl\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.525728 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.525698 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvgsd\" (UniqueName: \"kubernetes.io/projected/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-kube-api-access-kvgsd\") pod \"limitador-limitador-64c94fd64f-bh8wl\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.584274 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.584236 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:06.725355 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:06.725329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:06.726996 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:06.726963 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e21e9a_f4b1_47e1_9d25_d4d0f0be4322.slice/crio-ed7add71760da7340a2fa9d1e2a2fee7f4f806b6c26c75ecbf26bd947dcc8aed WatchSource:0}: Error finding container ed7add71760da7340a2fa9d1e2a2fee7f4f806b6c26c75ecbf26bd947dcc8aed: Status 404 returned error can't find the container with id ed7add71760da7340a2fa9d1e2a2fee7f4f806b6c26c75ecbf26bd947dcc8aed Jul 22 13:55:07.104357 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.104326 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z7d4v"] Jul 22 13:55:07.108778 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.108762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:07.110750 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.110732 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jl8m6\"" Jul 22 13:55:07.114775 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.114753 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7d4v"] Jul 22 13:55:07.138022 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.137990 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:07.198966 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.198938 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:07.223194 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.223165 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rp6\" (UniqueName: \"kubernetes.io/projected/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c-kube-api-access-r8rp6\") pod \"authorino-58cd955675-z7d4v\" (UID: \"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c\") " pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:07.226533 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.226514 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd9nj"] Jul 22 13:55:07.229764 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.229750 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:07.235531 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.235497 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd9nj"] Jul 22 13:55:07.271577 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.271545 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" event={"ID":"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322","Type":"ContainerStarted","Data":"ed7add71760da7340a2fa9d1e2a2fee7f4f806b6c26c75ecbf26bd947dcc8aed"} Jul 22 13:55:07.324394 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.324363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rp6\" (UniqueName: \"kubernetes.io/projected/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c-kube-api-access-r8rp6\") pod \"authorino-58cd955675-z7d4v\" (UID: \"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c\") " pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:07.324561 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.324407 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg99z\" (UniqueName: \"kubernetes.io/projected/b4ffc427-fdc1-4808-96fd-48a02961d668-kube-api-access-cg99z\") pod \"authorino-75d556bd77-nd9nj\" (UID: \"b4ffc427-fdc1-4808-96fd-48a02961d668\") " pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:07.332966 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.332938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rp6\" (UniqueName: \"kubernetes.io/projected/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c-kube-api-access-r8rp6\") pod \"authorino-58cd955675-z7d4v\" (UID: \"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c\") " pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:07.419257 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.419171 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:07.425438 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.425416 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg99z\" (UniqueName: \"kubernetes.io/projected/b4ffc427-fdc1-4808-96fd-48a02961d668-kube-api-access-cg99z\") pod \"authorino-75d556bd77-nd9nj\" (UID: \"b4ffc427-fdc1-4808-96fd-48a02961d668\") " pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:07.434470 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.434443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg99z\" (UniqueName: \"kubernetes.io/projected/b4ffc427-fdc1-4808-96fd-48a02961d668-kube-api-access-cg99z\") pod \"authorino-75d556bd77-nd9nj\" (UID: \"b4ffc427-fdc1-4808-96fd-48a02961d668\") " pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:07.540413 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.540375 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:07.547108 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.547082 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7d4v"] Jul 22 13:55:07.551132 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:07.551104 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b7f559c_8ed6_4208_9a1a_bd6ce5f26c4c.slice/crio-085b10329f83da49647433887f95d4254b33c42aa8e1ed8b366de7a385636f7f WatchSource:0}: Error finding container 085b10329f83da49647433887f95d4254b33c42aa8e1ed8b366de7a385636f7f: Status 404 returned error can't find the container with id 085b10329f83da49647433887f95d4254b33c42aa8e1ed8b366de7a385636f7f Jul 22 13:55:07.682236 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:07.681961 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd9nj"] Jul 22 13:55:07.685588 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:07.685548 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4ffc427_fdc1_4808_96fd_48a02961d668.slice/crio-2d430a35338c2bf46f289394f1a65bedb8ea5de9710559917a80586183ebdc47 WatchSource:0}: Error finding container 2d430a35338c2bf46f289394f1a65bedb8ea5de9710559917a80586183ebdc47: Status 404 returned error can't find the container with id 2d430a35338c2bf46f289394f1a65bedb8ea5de9710559917a80586183ebdc47 Jul 22 13:55:08.279519 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:08.279480 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7d4v" event={"ID":"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c","Type":"ContainerStarted","Data":"085b10329f83da49647433887f95d4254b33c42aa8e1ed8b366de7a385636f7f"} Jul 22 13:55:08.280855 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:08.280828 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd9nj" event={"ID":"b4ffc427-fdc1-4808-96fd-48a02961d668","Type":"ContainerStarted","Data":"2d430a35338c2bf46f289394f1a65bedb8ea5de9710559917a80586183ebdc47"} Jul 22 13:55:12.305584 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.305549 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" event={"ID":"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322","Type":"ContainerStarted","Data":"203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8"} Jul 22 13:55:12.306021 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.305635 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:12.307099 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.307078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd9nj" event={"ID":"b4ffc427-fdc1-4808-96fd-48a02961d668","Type":"ContainerStarted","Data":"3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857"} Jul 22 13:55:12.308456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.308435 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7d4v" event={"ID":"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c","Type":"ContainerStarted","Data":"959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043"} Jul 22 13:55:12.323461 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.323419 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" podStartSLOduration=1.423739911 podStartE2EDuration="6.323406563s" totalImagesPullingTime="4.899666652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:12.321985622 +0000 UTC m=+538.972001665" watchObservedRunningTime="2026-07-22 13:55:12.323406563 +0000 UTC m=+538.973422603" Jul 22 13:55:12.336274 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.336233 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z7d4v" podStartSLOduration=1.260023368 podStartE2EDuration="5.336219636s" totalImagesPullingTime="4.076196268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:12.334889693 +0000 UTC m=+538.984905734" watchObservedRunningTime="2026-07-22 13:55:12.336219636 +0000 UTC m=+538.986235706" Jul 22 13:55:12.351832 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.351776 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nd9nj" podStartSLOduration=1.406681979 podStartE2EDuration="5.351758578s" totalImagesPullingTime="3.945076599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:12.348139696 +0000 UTC m=+538.998155737" watchObservedRunningTime="2026-07-22 13:55:12.351758578 +0000 UTC m=+539.001774619" Jul 22 13:55:12.377076 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:12.377049 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7d4v"] Jul 22 13:55:14.318850 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:14.318789 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z7d4v" podUID="3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" containerName="authorino" containerID="cri-o://959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043" gracePeriod=30 Jul 22 13:55:14.566763 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:14.566742 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:14.698361 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:14.698329 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8rp6\" (UniqueName: \"kubernetes.io/projected/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c-kube-api-access-r8rp6\") pod \"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c\" (UID: \"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c\") " Jul 22 13:55:14.700492 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:14.700465 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c-kube-api-access-r8rp6" (OuterVolumeSpecName: "kube-api-access-r8rp6") pod "3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" (UID: "3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c"). InnerVolumeSpecName "kube-api-access-r8rp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:55:14.798900 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:14.798870 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8rp6\" (UniqueName: \"kubernetes.io/projected/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c-kube-api-access-r8rp6\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:55:15.326081 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.326048 2556 generic.go:356] "Generic (PLEG): container finished" podID="3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" containerID="959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043" exitCode=0 Jul 22 13:55:15.326484 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.326093 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z7d4v" Jul 22 13:55:15.326484 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.326104 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7d4v" event={"ID":"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c","Type":"ContainerDied","Data":"959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043"} Jul 22 13:55:15.326484 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.326136 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z7d4v" event={"ID":"3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c","Type":"ContainerDied","Data":"085b10329f83da49647433887f95d4254b33c42aa8e1ed8b366de7a385636f7f"} Jul 22 13:55:15.326484 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.326152 2556 scope.go:117] "RemoveContainer" containerID="959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043" Jul 22 13:55:15.334508 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.334490 2556 scope.go:117] "RemoveContainer" containerID="959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043" Jul 22 13:55:15.334752 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:55:15.334734 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043\": container with ID starting with 959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043 not found: ID does not exist" containerID="959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043" Jul 22 13:55:15.334808 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.334759 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043"} err="failed to get container status \"959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043\": rpc error: code = NotFound desc = could not find container \"959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043\": container with ID starting with 959bda1ab8c77eb71df9e086a2444c0f802a656340d7b303140756aeba4c2043 not found: ID does not exist" Jul 22 13:55:15.347372 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.347348 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7d4v"] Jul 22 13:55:15.354850 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.354828 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z7d4v"] Jul 22 13:55:15.822261 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:15.822230 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" path="/var/lib/kubelet/pods/3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c/volumes" Jul 22 13:55:21.550213 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:21.550179 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:21.550773 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:21.550380 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" podUID="03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" containerName="limitador" containerID="cri-o://203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8" gracePeriod=30 Jul 22 13:55:21.551225 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:21.551111 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:22.100703 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.100681 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:22.256751 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.256670 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-config-file\") pod \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " Jul 22 13:55:22.256947 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.256770 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvgsd\" (UniqueName: \"kubernetes.io/projected/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-kube-api-access-kvgsd\") pod \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\" (UID: \"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322\") " Jul 22 13:55:22.257105 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.257081 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-config-file" (OuterVolumeSpecName: "config-file") pod "03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" (UID: "03e21e9a-f4b1-47e1-9d25-d4d0f0be4322"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:55:22.258874 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.258849 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-kube-api-access-kvgsd" (OuterVolumeSpecName: "kube-api-access-kvgsd") pod "03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" (UID: "03e21e9a-f4b1-47e1-9d25-d4d0f0be4322"). InnerVolumeSpecName "kube-api-access-kvgsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:55:22.358385 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.358360 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-config-file\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:55:22.358385 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.358384 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvgsd\" (UniqueName: \"kubernetes.io/projected/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322-kube-api-access-kvgsd\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:55:22.363751 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.363723 2556 generic.go:356] "Generic (PLEG): container finished" podID="03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" containerID="203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8" exitCode=0 Jul 22 13:55:22.363876 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.363772 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" Jul 22 13:55:22.363876 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.363813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" event={"ID":"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322","Type":"ContainerDied","Data":"203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8"} Jul 22 13:55:22.363876 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.363870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bh8wl" event={"ID":"03e21e9a-f4b1-47e1-9d25-d4d0f0be4322","Type":"ContainerDied","Data":"ed7add71760da7340a2fa9d1e2a2fee7f4f806b6c26c75ecbf26bd947dcc8aed"} Jul 22 13:55:22.364010 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.363895 2556 scope.go:117] "RemoveContainer" containerID="203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8" Jul 22 13:55:22.373339 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.373319 2556 scope.go:117] "RemoveContainer" containerID="203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8" Jul 22 13:55:22.373574 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:55:22.373553 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8\": container with ID starting with 203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8 not found: ID does not exist" containerID="203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8" Jul 22 13:55:22.373633 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.373582 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8"} err="failed to get container status \"203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8\": rpc error: code = NotFound desc = could not find container \"203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8\": container with ID starting with 203ba9c1037bb505fd2e1bdceae147fb4def749e883e2ae9d2025197fae2fbc8 not found: ID does not exist" Jul 22 13:55:22.386419 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.386395 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:22.390670 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:22.390648 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bh8wl"] Jul 22 13:55:23.822035 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:23.822002 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" path="/var/lib/kubelet/pods/03e21e9a-f4b1-47e1-9d25-d4d0f0be4322/volumes" Jul 22 13:55:27.593239 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:27.593189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:27.691556 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:27.691522 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:28.292015 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.291987 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5"] Jul 22 13:55:28.292341 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.292327 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" containerName="authorino" Jul 22 13:55:28.292341 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.292344 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" containerName="authorino" Jul 22 13:55:28.292455 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.292358 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" containerName="limitador" Jul 22 13:55:28.292455 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.292363 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" containerName="limitador" Jul 22 13:55:28.292455 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.292428 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7f559c-8ed6-4208-9a1a-bd6ce5f26c4c" containerName="authorino" Jul 22 13:55:28.292455 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.292439 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e21e9a-f4b1-47e1-9d25-d4d0f0be4322" containerName="limitador" Jul 22 13:55:28.296700 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.296680 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.298842 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.298820 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 13:55:28.299089 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.299072 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 22 13:55:28.299159 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.299097 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 13:55:28.299159 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.299110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4xtzc\"" Jul 22 13:55:28.304323 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.304304 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5"] Jul 22 13:55:28.308760 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.308736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f6d99ea-1dea-409e-9a3e-c1945d832a80-data\") pod \"postgres-69fb4594cf-sxhf5\" (UID: \"4f6d99ea-1dea-409e-9a3e-c1945d832a80\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.308873 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.308855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w755\" (UniqueName: \"kubernetes.io/projected/4f6d99ea-1dea-409e-9a3e-c1945d832a80-kube-api-access-4w755\") pod \"postgres-69fb4594cf-sxhf5\" (UID: \"4f6d99ea-1dea-409e-9a3e-c1945d832a80\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.327101 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.327067 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:28.409955 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.409903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f6d99ea-1dea-409e-9a3e-c1945d832a80-data\") pod \"postgres-69fb4594cf-sxhf5\" (UID: \"4f6d99ea-1dea-409e-9a3e-c1945d832a80\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.410118 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.410040 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w755\" (UniqueName: \"kubernetes.io/projected/4f6d99ea-1dea-409e-9a3e-c1945d832a80-kube-api-access-4w755\") pod \"postgres-69fb4594cf-sxhf5\" (UID: \"4f6d99ea-1dea-409e-9a3e-c1945d832a80\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.410350 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.410322 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f6d99ea-1dea-409e-9a3e-c1945d832a80-data\") pod \"postgres-69fb4594cf-sxhf5\" (UID: \"4f6d99ea-1dea-409e-9a3e-c1945d832a80\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.418981 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.418962 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w755\" (UniqueName: \"kubernetes.io/projected/4f6d99ea-1dea-409e-9a3e-c1945d832a80-kube-api-access-4w755\") pod \"postgres-69fb4594cf-sxhf5\" (UID: \"4f6d99ea-1dea-409e-9a3e-c1945d832a80\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.606765 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.606725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:28.735210 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:28.735187 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5"] Jul 22 13:55:28.736655 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:28.736626 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6d99ea_1dea_409e_9a3e_c1945d832a80.slice/crio-24f3c263f51ee187fb673257cd816539117b484223c8dd56216142224a0c3766 WatchSource:0}: Error finding container 24f3c263f51ee187fb673257cd816539117b484223c8dd56216142224a0c3766: Status 404 returned error can't find the container with id 24f3c263f51ee187fb673257cd816539117b484223c8dd56216142224a0c3766 Jul 22 13:55:29.407019 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:29.406980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" event={"ID":"4f6d99ea-1dea-409e-9a3e-c1945d832a80","Type":"ContainerStarted","Data":"24f3c263f51ee187fb673257cd816539117b484223c8dd56216142224a0c3766"} Jul 22 13:55:30.361633 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:30.361600 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:33.435519 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:33.435483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" event={"ID":"4f6d99ea-1dea-409e-9a3e-c1945d832a80","Type":"ContainerStarted","Data":"0ae44d1cda5f5706e3cf9606a141c2c2b1c74605b5f1fa16332e472175b901d1"} Jul 22 13:55:33.435834 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:33.435616 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:33.453045 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:33.453007 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" podStartSLOduration=0.862859459 podStartE2EDuration="5.452992479s" totalImagesPullingTime="4.59013302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:33.452288347 +0000 UTC m=+560.102304385" watchObservedRunningTime="2026-07-22 13:55:33.452992479 +0000 UTC m=+560.103008518" Jul 22 13:55:39.470553 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:39.470525 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxhf5" Jul 22 13:55:39.805815 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:39.805731 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:40.032303 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.032266 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5zvpc"] Jul 22 13:55:40.035741 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.035724 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:40.045044 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.045025 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5zvpc"] Jul 22 13:55:40.108535 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.108506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj24m\" (UniqueName: \"kubernetes.io/projected/53de4de7-fea5-4de3-9231-66760af82dc2-kube-api-access-sj24m\") pod \"authorino-5d4b67c446-5zvpc\" (UID: \"53de4de7-fea5-4de3-9231-66760af82dc2\") " pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:40.139265 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.139238 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:40.209745 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.209711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj24m\" (UniqueName: \"kubernetes.io/projected/53de4de7-fea5-4de3-9231-66760af82dc2-kube-api-access-sj24m\") pod \"authorino-5d4b67c446-5zvpc\" (UID: \"53de4de7-fea5-4de3-9231-66760af82dc2\") " pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:40.218482 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.218454 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj24m\" (UniqueName: \"kubernetes.io/projected/53de4de7-fea5-4de3-9231-66760af82dc2-kube-api-access-sj24m\") pod \"authorino-5d4b67c446-5zvpc\" (UID: \"53de4de7-fea5-4de3-9231-66760af82dc2\") " pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:40.278806 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.278779 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5zvpc"] Jul 22 13:55:40.279068 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.279056 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:40.307081 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.307057 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d79b88fbb-c54n2"] Jul 22 13:55:40.311216 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.311197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:40.320488 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.320465 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d79b88fbb-c54n2"] Jul 22 13:55:40.411653 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.411623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4f7s\" (UniqueName: \"kubernetes.io/projected/2cae2b43-9f30-4896-8b2a-f1d6517c7331-kube-api-access-z4f7s\") pod \"authorino-d79b88fbb-c54n2\" (UID: \"2cae2b43-9f30-4896-8b2a-f1d6517c7331\") " pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:40.432383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.432360 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5zvpc"] Jul 22 13:55:40.434543 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:40.434520 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53de4de7_fea5_4de3_9231_66760af82dc2.slice/crio-12333d9d7ff19a5cb222f52f7e70357532c2f5c118bf3048d30b2f03f41fe8d4 WatchSource:0}: Error finding container 12333d9d7ff19a5cb222f52f7e70357532c2f5c118bf3048d30b2f03f41fe8d4: Status 404 returned error can't find the container with id 12333d9d7ff19a5cb222f52f7e70357532c2f5c118bf3048d30b2f03f41fe8d4 Jul 22 13:55:40.444316 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.444295 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d79b88fbb-c54n2"] Jul 22 13:55:40.444548 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:55:40.444531 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-z4f7s], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-d79b88fbb-c54n2" podUID="2cae2b43-9f30-4896-8b2a-f1d6517c7331" Jul 22 13:55:40.470737 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.470718 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:40.471095 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.470749 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" event={"ID":"53de4de7-fea5-4de3-9231-66760af82dc2","Type":"ContainerStarted","Data":"12333d9d7ff19a5cb222f52f7e70357532c2f5c118bf3048d30b2f03f41fe8d4"} Jul 22 13:55:40.477614 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.477596 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:40.494269 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.494243 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59468b5f4b-q9z54"] Jul 22 13:55:40.497408 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.497388 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.500433 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.500419 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 13:55:40.509187 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.509160 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59468b5f4b-q9z54"] Jul 22 13:55:40.512363 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.512343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4f7s\" (UniqueName: \"kubernetes.io/projected/2cae2b43-9f30-4896-8b2a-f1d6517c7331-kube-api-access-z4f7s\") pod \"authorino-d79b88fbb-c54n2\" (UID: \"2cae2b43-9f30-4896-8b2a-f1d6517c7331\") " pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:40.525573 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.525551 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4f7s\" (UniqueName: \"kubernetes.io/projected/2cae2b43-9f30-4896-8b2a-f1d6517c7331-kube-api-access-z4f7s\") pod \"authorino-d79b88fbb-c54n2\" (UID: \"2cae2b43-9f30-4896-8b2a-f1d6517c7331\") " pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:40.613433 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.613404 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4f7s\" (UniqueName: \"kubernetes.io/projected/2cae2b43-9f30-4896-8b2a-f1d6517c7331-kube-api-access-z4f7s\") pod \"2cae2b43-9f30-4896-8b2a-f1d6517c7331\" (UID: \"2cae2b43-9f30-4896-8b2a-f1d6517c7331\") " Jul 22 13:55:40.613578 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.613567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7snb\" (UniqueName: \"kubernetes.io/projected/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-kube-api-access-q7snb\") pod \"authorino-59468b5f4b-q9z54\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.613628 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.613619 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-tls-cert\") pod \"authorino-59468b5f4b-q9z54\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.615429 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.615407 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cae2b43-9f30-4896-8b2a-f1d6517c7331-kube-api-access-z4f7s" (OuterVolumeSpecName: "kube-api-access-z4f7s") pod "2cae2b43-9f30-4896-8b2a-f1d6517c7331" (UID: "2cae2b43-9f30-4896-8b2a-f1d6517c7331"). InnerVolumeSpecName "kube-api-access-z4f7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:55:40.714490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.714423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7snb\" (UniqueName: \"kubernetes.io/projected/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-kube-api-access-q7snb\") pod \"authorino-59468b5f4b-q9z54\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.714490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.714478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-tls-cert\") pod \"authorino-59468b5f4b-q9z54\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.714665 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.714530 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4f7s\" (UniqueName: \"kubernetes.io/projected/2cae2b43-9f30-4896-8b2a-f1d6517c7331-kube-api-access-z4f7s\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:55:40.716665 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.716648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-tls-cert\") pod \"authorino-59468b5f4b-q9z54\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.724462 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.724445 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7snb\" (UniqueName: \"kubernetes.io/projected/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-kube-api-access-q7snb\") pod \"authorino-59468b5f4b-q9z54\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.805678 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.805645 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:55:40.942485 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:40.942461 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59468b5f4b-q9z54"] Jul 22 13:55:40.944673 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:40.944649 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14f1dbbb_c1c4_4e1c_854e_99b7b4f11cbc.slice/crio-c1cfc736219fd93b8c0da0bb318e6f85ee757086373a0d74026fc0a29a562519 WatchSource:0}: Error finding container c1cfc736219fd93b8c0da0bb318e6f85ee757086373a0d74026fc0a29a562519: Status 404 returned error can't find the container with id c1cfc736219fd93b8c0da0bb318e6f85ee757086373a0d74026fc0a29a562519 Jul 22 13:55:41.478113 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.478019 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" event={"ID":"53de4de7-fea5-4de3-9231-66760af82dc2","Type":"ContainerStarted","Data":"d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce"} Jul 22 13:55:41.478113 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.478072 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" podUID="53de4de7-fea5-4de3-9231-66760af82dc2" containerName="authorino" containerID="cri-o://d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce" gracePeriod=30 Jul 22 13:55:41.479737 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.479703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59468b5f4b-q9z54" event={"ID":"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc","Type":"ContainerStarted","Data":"3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc"} Jul 22 13:55:41.479737 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.479727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d79b88fbb-c54n2" Jul 22 13:55:41.479924 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.479733 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59468b5f4b-q9z54" event={"ID":"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc","Type":"ContainerStarted","Data":"c1cfc736219fd93b8c0da0bb318e6f85ee757086373a0d74026fc0a29a562519"} Jul 22 13:55:41.494557 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.494518 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" podStartSLOduration=1.086287371 podStartE2EDuration="1.49450655s" totalImagesPullingTime="408.219179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:41.493075004 +0000 UTC m=+568.143091057" watchObservedRunningTime="2026-07-22 13:55:41.49450655 +0000 UTC m=+568.144522649" Jul 22 13:55:41.516640 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.516615 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d79b88fbb-c54n2"] Jul 22 13:55:41.521856 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.521833 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d79b88fbb-c54n2"] Jul 22 13:55:41.540806 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.540763 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59468b5f4b-q9z54" podStartSLOduration=1.190796536 podStartE2EDuration="1.54075091s" totalImagesPullingTime="349.954374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:41.540113754 +0000 UTC m=+568.190129793" watchObservedRunningTime="2026-07-22 13:55:41.54075091 +0000 UTC m=+568.190766948" Jul 22 13:55:41.569276 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.569247 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd9nj"] Jul 22 13:55:41.569421 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.569401 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nd9nj" podUID="b4ffc427-fdc1-4808-96fd-48a02961d668" containerName="authorino" containerID="cri-o://3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857" gracePeriod=30 Jul 22 13:55:41.822764 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.822737 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cae2b43-9f30-4896-8b2a-f1d6517c7331" path="/var/lib/kubelet/pods/2cae2b43-9f30-4896-8b2a-f1d6517c7331/volumes" Jul 22 13:55:41.831995 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.831971 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:41.842938 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.842919 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:41.924567 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.924539 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg99z\" (UniqueName: \"kubernetes.io/projected/b4ffc427-fdc1-4808-96fd-48a02961d668-kube-api-access-cg99z\") pod \"b4ffc427-fdc1-4808-96fd-48a02961d668\" (UID: \"b4ffc427-fdc1-4808-96fd-48a02961d668\") " Jul 22 13:55:41.924737 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.924588 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj24m\" (UniqueName: \"kubernetes.io/projected/53de4de7-fea5-4de3-9231-66760af82dc2-kube-api-access-sj24m\") pod \"53de4de7-fea5-4de3-9231-66760af82dc2\" (UID: \"53de4de7-fea5-4de3-9231-66760af82dc2\") " Jul 22 13:55:41.926651 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.926614 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53de4de7-fea5-4de3-9231-66760af82dc2-kube-api-access-sj24m" (OuterVolumeSpecName: "kube-api-access-sj24m") pod "53de4de7-fea5-4de3-9231-66760af82dc2" (UID: "53de4de7-fea5-4de3-9231-66760af82dc2"). InnerVolumeSpecName "kube-api-access-sj24m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:55:41.926758 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:41.926734 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ffc427-fdc1-4808-96fd-48a02961d668-kube-api-access-cg99z" (OuterVolumeSpecName: "kube-api-access-cg99z") pod "b4ffc427-fdc1-4808-96fd-48a02961d668" (UID: "b4ffc427-fdc1-4808-96fd-48a02961d668"). InnerVolumeSpecName "kube-api-access-cg99z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:55:42.025845 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.025762 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg99z\" (UniqueName: \"kubernetes.io/projected/b4ffc427-fdc1-4808-96fd-48a02961d668-kube-api-access-cg99z\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:55:42.025845 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.025794 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj24m\" (UniqueName: \"kubernetes.io/projected/53de4de7-fea5-4de3-9231-66760af82dc2-kube-api-access-sj24m\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:55:42.486277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.486245 2556 generic.go:356] "Generic (PLEG): container finished" podID="53de4de7-fea5-4de3-9231-66760af82dc2" containerID="d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce" exitCode=0 Jul 22 13:55:42.486277 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.486280 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" Jul 22 13:55:42.486847 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.486337 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" event={"ID":"53de4de7-fea5-4de3-9231-66760af82dc2","Type":"ContainerDied","Data":"d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce"} Jul 22 13:55:42.486847 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.486378 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5zvpc" event={"ID":"53de4de7-fea5-4de3-9231-66760af82dc2","Type":"ContainerDied","Data":"12333d9d7ff19a5cb222f52f7e70357532c2f5c118bf3048d30b2f03f41fe8d4"} Jul 22 13:55:42.486847 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.486398 2556 scope.go:117] "RemoveContainer" containerID="d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce" Jul 22 13:55:42.487756 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.487691 2556 generic.go:356] "Generic (PLEG): container finished" podID="b4ffc427-fdc1-4808-96fd-48a02961d668" containerID="3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857" exitCode=0 Jul 22 13:55:42.487756 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.487732 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nd9nj" Jul 22 13:55:42.487898 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.487773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd9nj" event={"ID":"b4ffc427-fdc1-4808-96fd-48a02961d668","Type":"ContainerDied","Data":"3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857"} Jul 22 13:55:42.487898 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.487804 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nd9nj" event={"ID":"b4ffc427-fdc1-4808-96fd-48a02961d668","Type":"ContainerDied","Data":"2d430a35338c2bf46f289394f1a65bedb8ea5de9710559917a80586183ebdc47"} Jul 22 13:55:42.499827 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.499805 2556 scope.go:117] "RemoveContainer" containerID="d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce" Jul 22 13:55:42.500259 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:55:42.500238 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce\": container with ID starting with d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce not found: ID does not exist" containerID="d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce" Jul 22 13:55:42.500348 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.500276 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce"} err="failed to get container status \"d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce\": rpc error: code = NotFound desc = could not find container \"d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce\": container with ID starting with d46a1007da9c161d3b64082892633c535de0df23b5cc498797a80466ba1cb7ce not found: ID does not exist" Jul 22 13:55:42.500348 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.500296 2556 scope.go:117] "RemoveContainer" containerID="3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857" Jul 22 13:55:42.508590 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.508574 2556 scope.go:117] "RemoveContainer" containerID="3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857" Jul 22 13:55:42.508880 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:55:42.508859 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857\": container with ID starting with 3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857 not found: ID does not exist" containerID="3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857" Jul 22 13:55:42.508953 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.508889 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857"} err="failed to get container status \"3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857\": rpc error: code = NotFound desc = could not find container \"3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857\": container with ID starting with 3479a90f08fbc41ff0e1bd06e2143d29c32b91c0938f83b920d1c1fe2971e857 not found: ID does not exist" Jul 22 13:55:42.516358 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.516332 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5zvpc"] Jul 22 13:55:42.529209 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.529186 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5zvpc"] Jul 22 13:55:42.552178 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.552151 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd9nj"] Jul 22 13:55:42.558547 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:42.558521 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nd9nj"] Jul 22 13:55:43.823055 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:43.823023 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53de4de7-fea5-4de3-9231-66760af82dc2" path="/var/lib/kubelet/pods/53de4de7-fea5-4de3-9231-66760af82dc2/volumes" Jul 22 13:55:43.823446 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:43.823340 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ffc427-fdc1-4808-96fd-48a02961d668" path="/var/lib/kubelet/pods/b4ffc427-fdc1-4808-96fd-48a02961d668/volumes" Jul 22 13:55:46.643012 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.642955 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:46.658605 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.658567 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cd87797f4-dbd54"] Jul 22 13:55:46.659029 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.659013 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53de4de7-fea5-4de3-9231-66760af82dc2" containerName="authorino" Jul 22 13:55:46.659132 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.659031 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="53de4de7-fea5-4de3-9231-66760af82dc2" containerName="authorino" Jul 22 13:55:46.659132 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.659073 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ffc427-fdc1-4808-96fd-48a02961d668" containerName="authorino" Jul 22 13:55:46.659132 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.659083 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ffc427-fdc1-4808-96fd-48a02961d668" containerName="authorino" Jul 22 13:55:46.659279 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.659161 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ffc427-fdc1-4808-96fd-48a02961d668" containerName="authorino" Jul 22 13:55:46.659279 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.659179 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="53de4de7-fea5-4de3-9231-66760af82dc2" containerName="authorino" Jul 22 13:55:46.750616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.750581 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:46.889862 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.889825 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd87797f4-dbd54"] Jul 22 13:55:46.890054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.889873 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-d224w"] Jul 22 13:55:46.890054 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.889961 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:46.890889 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.890864 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:46.892250 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.892228 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 13:55:46.892992 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.892973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h2x5c\"" Jul 22 13:55:46.893141 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.892995 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 13:55:46.918663 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.918639 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-d224w"] Jul 22 13:55:46.918793 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.918752 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:46.970377 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.970347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-webhook-cert\") pod \"maas-controller-cd87797f4-dbd54\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:46.970377 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.970378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfftg\" (UniqueName: \"kubernetes.io/projected/556831dc-cf11-49dd-8cf3-a33939fa9a91-kube-api-access-xfftg\") pod \"maas-controller-7fdc48c68d-d224w\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:46.970571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.970413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/556831dc-cf11-49dd-8cf3-a33939fa9a91-webhook-cert\") pod \"maas-controller-7fdc48c68d-d224w\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:46.970571 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:46.970493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lqh5\" (UniqueName: \"kubernetes.io/projected/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-kube-api-access-7lqh5\") pod \"maas-controller-cd87797f4-dbd54\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:47.071943 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.071890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-webhook-cert\") pod \"maas-controller-cd87797f4-dbd54\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:47.071943 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.071944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfftg\" (UniqueName: \"kubernetes.io/projected/556831dc-cf11-49dd-8cf3-a33939fa9a91-kube-api-access-xfftg\") pod \"maas-controller-7fdc48c68d-d224w\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:47.072138 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.071969 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/556831dc-cf11-49dd-8cf3-a33939fa9a91-webhook-cert\") pod \"maas-controller-7fdc48c68d-d224w\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:47.072138 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.071994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lqh5\" (UniqueName: \"kubernetes.io/projected/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-kube-api-access-7lqh5\") pod \"maas-controller-cd87797f4-dbd54\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:47.074329 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.074299 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-webhook-cert\") pod \"maas-controller-cd87797f4-dbd54\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:47.074329 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.074309 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/556831dc-cf11-49dd-8cf3-a33939fa9a91-webhook-cert\") pod \"maas-controller-7fdc48c68d-d224w\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:47.083817 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.083795 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lqh5\" (UniqueName: \"kubernetes.io/projected/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-kube-api-access-7lqh5\") pod \"maas-controller-cd87797f4-dbd54\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:47.084248 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.084230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfftg\" (UniqueName: \"kubernetes.io/projected/556831dc-cf11-49dd-8cf3-a33939fa9a91-kube-api-access-xfftg\") pod \"maas-controller-7fdc48c68d-d224w\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:47.200396 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.200315 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:47.228295 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.228269 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:47.377456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.377427 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cd87797f4-dbd54"] Jul 22 13:55:47.379969 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:47.379946 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b2a714_5670_4b6f_b572_d38c65cf1d5b.slice/crio-51704dcdad722a75dce110ae3398643b8d25ea9d2848c2d951761ad7e8b81d67 WatchSource:0}: Error finding container 51704dcdad722a75dce110ae3398643b8d25ea9d2848c2d951761ad7e8b81d67: Status 404 returned error can't find the container with id 51704dcdad722a75dce110ae3398643b8d25ea9d2848c2d951761ad7e8b81d67 Jul 22 13:55:47.402739 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.402718 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-d224w"] Jul 22 13:55:47.403919 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:55:47.403886 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556831dc_cf11_49dd_8cf3_a33939fa9a91.slice/crio-7f2b9fd7fd021d3be16c2b660c918c89be5bab71c101ba12d3471648837ab79f WatchSource:0}: Error finding container 7f2b9fd7fd021d3be16c2b660c918c89be5bab71c101ba12d3471648837ab79f: Status 404 returned error can't find the container with id 7f2b9fd7fd021d3be16c2b660c918c89be5bab71c101ba12d3471648837ab79f Jul 22 13:55:47.518124 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.518036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd87797f4-dbd54" event={"ID":"d2b2a714-5670-4b6f-b572-d38c65cf1d5b","Type":"ContainerStarted","Data":"51704dcdad722a75dce110ae3398643b8d25ea9d2848c2d951761ad7e8b81d67"} Jul 22 13:55:47.519120 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:47.519095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-d224w" event={"ID":"556831dc-cf11-49dd-8cf3-a33939fa9a91","Type":"ContainerStarted","Data":"7f2b9fd7fd021d3be16c2b660c918c89be5bab71c101ba12d3471648837ab79f"} Jul 22 13:55:50.351663 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.351630 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:50.462485 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.462369 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:55:50.541186 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.541148 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-d224w" event={"ID":"556831dc-cf11-49dd-8cf3-a33939fa9a91","Type":"ContainerStarted","Data":"3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0"} Jul 22 13:55:50.541399 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.541240 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:55:50.542612 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.542590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd87797f4-dbd54" event={"ID":"d2b2a714-5670-4b6f-b572-d38c65cf1d5b","Type":"ContainerStarted","Data":"1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102"} Jul 22 13:55:50.542738 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.542636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:55:50.567660 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.567617 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fdc48c68d-d224w" podStartSLOduration=1.8169571119999999 podStartE2EDuration="4.567603272s" totalImagesPullingTime="2.75064616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:50.567183261 +0000 UTC m=+577.217199301" watchObservedRunningTime="2026-07-22 13:55:50.567603272 +0000 UTC m=+577.217619312" Jul 22 13:55:50.585774 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:55:50.585727 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cd87797f4-dbd54" podStartSLOduration=1.817874841 podStartE2EDuration="4.585709523s" totalImagesPullingTime="2.767834682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:55:50.584504151 +0000 UTC m=+577.234520190" watchObservedRunningTime="2026-07-22 13:55:50.585709523 +0000 UTC m=+577.235725564" Jul 22 13:56:01.549429 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:01.549397 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:56:01.549889 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:01.549465 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:56:01.622762 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:01.622733 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cd87797f4-dbd54"] Jul 22 13:56:01.622975 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:01.622944 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cd87797f4-dbd54" podUID="d2b2a714-5670-4b6f-b572-d38c65cf1d5b" containerName="manager" containerID="cri-o://1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102" gracePeriod=30 Jul 22 13:56:01.875215 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:01.875193 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:56:02.002619 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.002591 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-webhook-cert\") pod \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " Jul 22 13:56:02.002813 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.002641 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lqh5\" (UniqueName: \"kubernetes.io/projected/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-kube-api-access-7lqh5\") pod \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\" (UID: \"d2b2a714-5670-4b6f-b572-d38c65cf1d5b\") " Jul 22 13:56:02.005045 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.005010 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d2b2a714-5670-4b6f-b572-d38c65cf1d5b" (UID: "d2b2a714-5670-4b6f-b572-d38c65cf1d5b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:56:02.005194 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.005140 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-kube-api-access-7lqh5" (OuterVolumeSpecName: "kube-api-access-7lqh5") pod "d2b2a714-5670-4b6f-b572-d38c65cf1d5b" (UID: "d2b2a714-5670-4b6f-b572-d38c65cf1d5b"). InnerVolumeSpecName "kube-api-access-7lqh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:56:02.104189 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.104145 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-webhook-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:56:02.104189 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.104181 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lqh5\" (UniqueName: \"kubernetes.io/projected/d2b2a714-5670-4b6f-b572-d38c65cf1d5b-kube-api-access-7lqh5\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:56:02.611073 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.611041 2556 generic.go:356] "Generic (PLEG): container finished" podID="d2b2a714-5670-4b6f-b572-d38c65cf1d5b" containerID="1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102" exitCode=0 Jul 22 13:56:02.611456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.611085 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cd87797f4-dbd54" Jul 22 13:56:02.611456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.611125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd87797f4-dbd54" event={"ID":"d2b2a714-5670-4b6f-b572-d38c65cf1d5b","Type":"ContainerDied","Data":"1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102"} Jul 22 13:56:02.611456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.611175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cd87797f4-dbd54" event={"ID":"d2b2a714-5670-4b6f-b572-d38c65cf1d5b","Type":"ContainerDied","Data":"51704dcdad722a75dce110ae3398643b8d25ea9d2848c2d951761ad7e8b81d67"} Jul 22 13:56:02.611456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.611197 2556 scope.go:117] "RemoveContainer" containerID="1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102" Jul 22 13:56:02.620770 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.620753 2556 scope.go:117] "RemoveContainer" containerID="1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102" Jul 22 13:56:02.621077 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:56:02.621059 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102\": container with ID starting with 1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102 not found: ID does not exist" containerID="1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102" Jul 22 13:56:02.621155 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.621090 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102"} err="failed to get container status \"1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102\": rpc error: code = NotFound desc = could not find container \"1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102\": container with ID starting with 1ac81d27bb3cd00fc0c1ada2726add2ef0e98bab969742cacfe6327fc5deb102 not found: ID does not exist" Jul 22 13:56:02.634048 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.634016 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cd87797f4-dbd54"] Jul 22 13:56:02.638216 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:02.638182 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cd87797f4-dbd54"] Jul 22 13:56:03.821779 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:03.821745 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b2a714-5670-4b6f-b572-d38c65cf1d5b" path="/var/lib/kubelet/pods/d2b2a714-5670-4b6f-b572-d38c65cf1d5b/volumes" Jul 22 13:56:11.185465 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:11.185431 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:13.735557 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:13.735526 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:56:13.737445 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:13.737421 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 13:56:22.064441 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.064400 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:22.156059 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.156024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:22.625170 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.625144 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:22.666261 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.666233 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf"] Jul 22 13:56:22.666663 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.666645 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b2a714-5670-4b6f-b572-d38c65cf1d5b" containerName="manager" Jul 22 13:56:22.666758 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.666666 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b2a714-5670-4b6f-b572-d38c65cf1d5b" containerName="manager" Jul 22 13:56:22.666815 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.666798 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b2a714-5670-4b6f-b572-d38c65cf1d5b" containerName="manager" Jul 22 13:56:22.669898 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.669878 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.672158 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.672137 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 22 13:56:22.681732 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.681710 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf"] Jul 22 13:56:22.789210 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.789173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af4c5f-c476-436e-99a1-550b89b5013e-openshift-service-ca\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.789393 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.789259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01af4c5f-c476-436e-99a1-550b89b5013e-maas-api-tls\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.789393 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.789318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4k59\" (UniqueName: \"kubernetes.io/projected/01af4c5f-c476-436e-99a1-550b89b5013e-kube-api-access-k4k59\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.890661 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.890570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4k59\" (UniqueName: \"kubernetes.io/projected/01af4c5f-c476-436e-99a1-550b89b5013e-kube-api-access-k4k59\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.890661 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.890623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af4c5f-c476-436e-99a1-550b89b5013e-openshift-service-ca\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.890982 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.890956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01af4c5f-c476-436e-99a1-550b89b5013e-maas-api-tls\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.891323 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.891300 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af4c5f-c476-436e-99a1-550b89b5013e-openshift-service-ca\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.893120 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.893095 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01af4c5f-c476-436e-99a1-550b89b5013e-maas-api-tls\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.900269 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.900247 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4k59\" (UniqueName: \"kubernetes.io/projected/01af4c5f-c476-436e-99a1-550b89b5013e-kube-api-access-k4k59\") pod \"maas-api-789b85bff9-hm2xf\" (UID: \"01af4c5f-c476-436e-99a1-550b89b5013e\") " pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:22.923880 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.923856 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:22.981064 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:22.981037 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:23.119691 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.119665 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf"] Jul 22 13:56:23.121859 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:56:23.121826 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01af4c5f_c476_436e_99a1_550b89b5013e.slice/crio-2b95650fac45d536516c544eda555aa77b6fe07b585c60e00a34b084fc83cea4 WatchSource:0}: Error finding container 2b95650fac45d536516c544eda555aa77b6fe07b585c60e00a34b084fc83cea4: Status 404 returned error can't find the container with id 2b95650fac45d536516c544eda555aa77b6fe07b585c60e00a34b084fc83cea4 Jul 22 13:56:23.123113 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.123095 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:56:23.151608 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.151546 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:23.240122 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.240096 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:23.248474 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.248440 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kwhtr"] Jul 22 13:56:23.253941 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.253900 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.256508 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.256315 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 13:56:23.256508 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.256394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6mvz6\"" Jul 22 13:56:23.258640 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.258621 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kwhtr"] Jul 22 13:56:23.267213 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.267193 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-49nn7"] Jul 22 13:56:23.271024 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.271007 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.282726 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.282707 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-49nn7"] Jul 22 13:56:23.294961 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.294939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g69l9\" (UniqueName: \"kubernetes.io/projected/eb69b457-0712-4395-b04e-a2a6e2f80c26-kube-api-access-g69l9\") pod \"payload-pre-processing-7677b774bb-kwhtr\" (UID: \"eb69b457-0712-4395-b04e-a2a6e2f80c26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.295078 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.295057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb69b457-0712-4395-b04e-a2a6e2f80c26-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kwhtr\" (UID: \"eb69b457-0712-4395-b04e-a2a6e2f80c26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.395684 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.395647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb69b457-0712-4395-b04e-a2a6e2f80c26-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kwhtr\" (UID: \"eb69b457-0712-4395-b04e-a2a6e2f80c26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.395874 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.395712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6px\" (UniqueName: \"kubernetes.io/projected/ea4f483b-180a-4be4-a1d7-44222434de98-kube-api-access-sw6px\") pod \"payload-processing-5bf47cd988-49nn7\" (UID: \"ea4f483b-180a-4be4-a1d7-44222434de98\") " pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.395874 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.395757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g69l9\" (UniqueName: \"kubernetes.io/projected/eb69b457-0712-4395-b04e-a2a6e2f80c26-kube-api-access-g69l9\") pod \"payload-pre-processing-7677b774bb-kwhtr\" (UID: \"eb69b457-0712-4395-b04e-a2a6e2f80c26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.395874 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.395859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea4f483b-180a-4be4-a1d7-44222434de98-plugins-config-volume\") pod \"payload-processing-5bf47cd988-49nn7\" (UID: \"ea4f483b-180a-4be4-a1d7-44222434de98\") " pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.396490 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.396470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb69b457-0712-4395-b04e-a2a6e2f80c26-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kwhtr\" (UID: \"eb69b457-0712-4395-b04e-a2a6e2f80c26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.403835 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.403779 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g69l9\" (UniqueName: \"kubernetes.io/projected/eb69b457-0712-4395-b04e-a2a6e2f80c26-kube-api-access-g69l9\") pod \"payload-pre-processing-7677b774bb-kwhtr\" (UID: \"eb69b457-0712-4395-b04e-a2a6e2f80c26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.496795 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.496758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6px\" (UniqueName: \"kubernetes.io/projected/ea4f483b-180a-4be4-a1d7-44222434de98-kube-api-access-sw6px\") pod \"payload-processing-5bf47cd988-49nn7\" (UID: \"ea4f483b-180a-4be4-a1d7-44222434de98\") " pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.496986 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.496843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea4f483b-180a-4be4-a1d7-44222434de98-plugins-config-volume\") pod \"payload-processing-5bf47cd988-49nn7\" (UID: \"ea4f483b-180a-4be4-a1d7-44222434de98\") " pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.497533 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.497514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea4f483b-180a-4be4-a1d7-44222434de98-plugins-config-volume\") pod \"payload-processing-5bf47cd988-49nn7\" (UID: \"ea4f483b-180a-4be4-a1d7-44222434de98\") " pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.504551 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.504526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6px\" (UniqueName: \"kubernetes.io/projected/ea4f483b-180a-4be4-a1d7-44222434de98-kube-api-access-sw6px\") pod \"payload-processing-5bf47cd988-49nn7\" (UID: \"ea4f483b-180a-4be4-a1d7-44222434de98\") " pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.566491 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.566440 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:23.580492 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.580467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:23.706542 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.706417 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kwhtr"] Jul 22 13:56:23.708694 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:56:23.708661 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb69b457_0712_4395_b04e_a2a6e2f80c26.slice/crio-3b616cb2e0b499f387f12b8445d17704696c6afc40ff4bcc7e8c780d240c822c WatchSource:0}: Error finding container 3b616cb2e0b499f387f12b8445d17704696c6afc40ff4bcc7e8c780d240c822c: Status 404 returned error can't find the container with id 3b616cb2e0b499f387f12b8445d17704696c6afc40ff4bcc7e8c780d240c822c Jul 22 13:56:23.727524 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.727494 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" event={"ID":"01af4c5f-c476-436e-99a1-550b89b5013e","Type":"ContainerStarted","Data":"2b95650fac45d536516c544eda555aa77b6fe07b585c60e00a34b084fc83cea4"} Jul 22 13:56:23.728799 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.728776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" event={"ID":"eb69b457-0712-4395-b04e-a2a6e2f80c26","Type":"ContainerStarted","Data":"3b616cb2e0b499f387f12b8445d17704696c6afc40ff4bcc7e8c780d240c822c"} Jul 22 13:56:23.942976 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:23.942943 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-49nn7"] Jul 22 13:56:23.946266 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:56:23.946241 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4f483b_180a_4be4_a1d7_44222434de98.slice/crio-c70b5321af268d7ffe9a4e12ec4c5f3c77d08a4a8a26e57df9e97e0e455c01f6 WatchSource:0}: Error finding container c70b5321af268d7ffe9a4e12ec4c5f3c77d08a4a8a26e57df9e97e0e455c01f6: Status 404 returned error can't find the container with id c70b5321af268d7ffe9a4e12ec4c5f3c77d08a4a8a26e57df9e97e0e455c01f6 Jul 22 13:56:24.738648 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:24.738588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" event={"ID":"ea4f483b-180a-4be4-a1d7-44222434de98","Type":"ContainerStarted","Data":"c70b5321af268d7ffe9a4e12ec4c5f3c77d08a4a8a26e57df9e97e0e455c01f6"} Jul 22 13:56:25.749396 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:25.749279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" event={"ID":"01af4c5f-c476-436e-99a1-550b89b5013e","Type":"ContainerStarted","Data":"26699bd3ce51f445361ebf8e84834a5708e2e2def70f44ff2e8998c763589dc3"} Jul 22 13:56:25.749830 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:25.749495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:25.773936 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:25.773044 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" podStartSLOduration=1.769979629 podStartE2EDuration="3.77302341s" totalImagesPullingTime="2.003043781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:56:25.76833481 +0000 UTC m=+612.418350851" watchObservedRunningTime="2026-07-22 13:56:25.77302341 +0000 UTC m=+612.423039451" Jul 22 13:56:26.787720 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:26.787676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" event={"ID":"ea4f483b-180a-4be4-a1d7-44222434de98","Type":"ContainerStarted","Data":"bb0b94ad66229a8e843eb539bd28cd34cdd3fde4c8e87e2de4ec6de554a702b5"} Jul 22 13:56:26.788559 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:26.788538 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:26.790098 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:26.790072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" event={"ID":"eb69b457-0712-4395-b04e-a2a6e2f80c26","Type":"ContainerStarted","Data":"e8ecbe7696f62493eed6b23de011194708765bac303426f373ea78208a247900"} Jul 22 13:56:26.790324 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:26.790294 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:26.804472 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:26.804422 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" podStartSLOduration=1.538626077 podStartE2EDuration="3.804410417s" totalImagesPullingTime="2.26578434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:56:26.803102514 +0000 UTC m=+613.453118556" watchObservedRunningTime="2026-07-22 13:56:26.804410417 +0000 UTC m=+613.454426457" Jul 22 13:56:26.819521 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:26.819485 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" podStartSLOduration=1.578850442 podStartE2EDuration="3.819469438s" totalImagesPullingTime="2.240618996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:56:26.818492233 +0000 UTC m=+613.468508276" watchObservedRunningTime="2026-07-22 13:56:26.819469438 +0000 UTC m=+613.469485479" Jul 22 13:56:31.796595 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.796566 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-789b85bff9-hm2xf" Jul 22 13:56:31.821494 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.821463 2556 generic.go:356] "Generic (PLEG): container finished" podID="5a6de980-514b-4488-8540-18c71b07c46d" containerID="9838dc8196bee44af681da3e0921f2cfa84646d754c096601f4b99e8d0842377" exitCode=0 Jul 22 13:56:31.821750 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.821727 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" event={"ID":"5a6de980-514b-4488-8540-18c71b07c46d","Type":"ContainerDied","Data":"9838dc8196bee44af681da3e0921f2cfa84646d754c096601f4b99e8d0842377"} Jul 22 13:56:31.822134 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.822116 2556 scope.go:117] "RemoveContainer" containerID="9838dc8196bee44af681da3e0921f2cfa84646d754c096601f4b99e8d0842377" Jul 22 13:56:31.823218 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.823097 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:56:31.823312 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.823272 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:56:31.823384 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:31.823332 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:56:32.829437 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:32.829398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" event={"ID":"5a6de980-514b-4488-8540-18c71b07c46d","Type":"ContainerStarted","Data":"4dbb023d81fd4d9a2737617a768e193c143c87b1baf6814b915a144ac7661fbe"} Jul 22 13:56:33.509672 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:33.509643 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:33.609329 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:33.609297 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:33.785194 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:33.785089 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:56:33.786467 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:33.786442 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 22 13:56:33.786539 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:33.786492 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" podUID="5a6de980-514b-4488-8540-18c71b07c46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 22 13:56:34.785354 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:34.785312 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 22 13:56:34.785839 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:34.785378 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" podUID="5a6de980-514b-4488-8540-18c71b07c46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 22 13:56:35.785545 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:35.785462 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 22 13:56:35.785545 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:35.785514 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" podUID="5a6de980-514b-4488-8540-18c71b07c46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 22 13:56:36.265566 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:36.265523 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:56:36.785589 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:36.785547 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-j5mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 22 13:56:36.786023 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:36.785604 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" podUID="5a6de980-514b-4488-8540-18c71b07c46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 22 13:56:37.789310 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:37.789281 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:56:37.790267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:37.790246 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-j5mv2" Jul 22 13:56:38.804076 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:38.804047 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-49nn7" Jul 22 13:56:38.804537 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:38.804244 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kwhtr" Jul 22 13:56:48.202737 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:48.202706 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:56:54.367509 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:56:54.367473 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:57:10.707353 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:10.707322 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:57:20.558178 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.558127 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n"] Jul 22 13:57:20.561726 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.561711 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.564534 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.564508 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 13:57:20.564672 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.564508 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s6zft\"" Jul 22 13:57:20.564672 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.564549 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 13:57:20.564672 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.564572 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 13:57:20.572816 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.572793 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n"] Jul 22 13:57:20.611353 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.611326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.611470 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.611370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.611470 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.611396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.611470 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.611454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp79s\" (UniqueName: \"kubernetes.io/projected/489dfd58-2abf-401b-a6d5-4e8da956d91d-kube-api-access-jp79s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.611643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.611516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.611643 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.611542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489dfd58-2abf-401b-a6d5-4e8da956d91d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712403 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712403 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp79s\" (UniqueName: \"kubernetes.io/projected/489dfd58-2abf-401b-a6d5-4e8da956d91d-kube-api-access-jp79s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489dfd58-2abf-401b-a6d5-4e8da956d91d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712616 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712851 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712830 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.712946 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712873 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.713009 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.712980 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.714787 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.714771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/489dfd58-2abf-401b-a6d5-4e8da956d91d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.715184 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.715166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/489dfd58-2abf-401b-a6d5-4e8da956d91d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.719955 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.719856 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:57:20.721712 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.721692 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp79s\" (UniqueName: \"kubernetes.io/projected/489dfd58-2abf-401b-a6d5-4e8da956d91d-kube-api-access-jp79s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n\" (UID: \"489dfd58-2abf-401b-a6d5-4e8da956d91d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:20.874210 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:20.874169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:21.012862 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:21.012817 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n"] Jul 22 13:57:21.015838 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:57:21.015811 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489dfd58_2abf_401b_a6d5_4e8da956d91d.slice/crio-acea6988719c7c39f09f3355b3d8958c5dade6b28889da579077bf057823c86f WatchSource:0}: Error finding container acea6988719c7c39f09f3355b3d8958c5dade6b28889da579077bf057823c86f: Status 404 returned error can't find the container with id acea6988719c7c39f09f3355b3d8958c5dade6b28889da579077bf057823c86f Jul 22 13:57:21.096044 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:21.096007 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" event={"ID":"489dfd58-2abf-401b-a6d5-4e8da956d91d","Type":"ContainerStarted","Data":"acea6988719c7c39f09f3355b3d8958c5dade6b28889da579077bf057823c86f"} Jul 22 13:57:23.108740 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:23.108700 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" event={"ID":"489dfd58-2abf-401b-a6d5-4e8da956d91d","Type":"ContainerStarted","Data":"d1fac3661e0c932aa38720b022471ddfc4aed503987fb539911358167cb9c050"} Jul 22 13:57:23.128896 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:23.128847 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" podStartSLOduration=2.090613736 podStartE2EDuration="3.128830747s" totalImagesPullingTime="1.038217011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:57:23.127264611 +0000 UTC m=+669.777280652" watchObservedRunningTime="2026-07-22 13:57:23.128830747 +0000 UTC m=+669.778846829" Jul 22 13:57:26.704143 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:26.704106 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:57:26.763758 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:26.763733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:57:29.601337 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:29.601307 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:57:30.874813 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:30.874782 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:30.875207 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:30.874848 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:30.887222 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:30.887204 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:31.164920 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:31.164826 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n" Jul 22 13:57:32.121551 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:57:32.121514 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:14.656617 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:14.656531 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:14.713632 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:14.713600 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:50.786833 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.786797 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cb94769cf-ffj97"] Jul 22 13:58:50.790291 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.790276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:50.798585 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.798563 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb94769cf-ffj97"] Jul 22 13:58:50.882428 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.882402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f58425c-f55c-400e-8755-83399620d5b4-tls-cert\") pod \"authorino-5cb94769cf-ffj97\" (UID: \"5f58425c-f55c-400e-8755-83399620d5b4\") " pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:50.882578 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.882444 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbnkq\" (UniqueName: \"kubernetes.io/projected/5f58425c-f55c-400e-8755-83399620d5b4-kube-api-access-qbnkq\") pod \"authorino-5cb94769cf-ffj97\" (UID: \"5f58425c-f55c-400e-8755-83399620d5b4\") " pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:50.983702 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.983675 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f58425c-f55c-400e-8755-83399620d5b4-tls-cert\") pod \"authorino-5cb94769cf-ffj97\" (UID: \"5f58425c-f55c-400e-8755-83399620d5b4\") " pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:50.983849 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.983718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbnkq\" (UniqueName: \"kubernetes.io/projected/5f58425c-f55c-400e-8755-83399620d5b4-kube-api-access-qbnkq\") pod \"authorino-5cb94769cf-ffj97\" (UID: \"5f58425c-f55c-400e-8755-83399620d5b4\") " pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:50.986071 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.986046 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f58425c-f55c-400e-8755-83399620d5b4-tls-cert\") pod \"authorino-5cb94769cf-ffj97\" (UID: \"5f58425c-f55c-400e-8755-83399620d5b4\") " pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:50.992159 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:50.992142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbnkq\" (UniqueName: \"kubernetes.io/projected/5f58425c-f55c-400e-8755-83399620d5b4-kube-api-access-qbnkq\") pod \"authorino-5cb94769cf-ffj97\" (UID: \"5f58425c-f55c-400e-8755-83399620d5b4\") " pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:51.099985 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:51.099961 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb94769cf-ffj97" Jul 22 13:58:51.216741 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:51.216709 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:51.244456 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:51.244418 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb94769cf-ffj97"] Jul 22 13:58:51.247532 ip-10-0-140-215 kubenswrapper[2556]: W0722 13:58:51.247506 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f58425c_f55c_400e_8755_83399620d5b4.slice/crio-c288df0712c774321d86dd338b7226280b31050e513e09286425e2fa66ae9b84 WatchSource:0}: Error finding container c288df0712c774321d86dd338b7226280b31050e513e09286425e2fa66ae9b84: Status 404 returned error can't find the container with id c288df0712c774321d86dd338b7226280b31050e513e09286425e2fa66ae9b84 Jul 22 13:58:51.292383 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:51.292348 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:51.589335 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:51.589261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb94769cf-ffj97" event={"ID":"5f58425c-f55c-400e-8755-83399620d5b4","Type":"ContainerStarted","Data":"c288df0712c774321d86dd338b7226280b31050e513e09286425e2fa66ae9b84"} Jul 22 13:58:52.361848 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.361815 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:52.456520 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.456486 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:58:52.599601 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.599563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb94769cf-ffj97" event={"ID":"5f58425c-f55c-400e-8755-83399620d5b4","Type":"ContainerStarted","Data":"3509f08b220c34a564572b927069c5046d95827682193ef283d5208dbedd05c7"} Jul 22 13:58:52.626411 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.626280 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cb94769cf-ffj97" podStartSLOduration=1.977216851 podStartE2EDuration="2.626256714s" totalImagesPullingTime="649.039863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:58:52.624403992 +0000 UTC m=+759.274420032" watchObservedRunningTime="2026-07-22 13:58:52.626256714 +0000 UTC m=+759.276272756" Jul 22 13:58:52.689267 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.689207 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59468b5f4b-q9z54"] Jul 22 13:58:52.690125 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.689455 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59468b5f4b-q9z54" podUID="14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" containerName="authorino" containerID="cri-o://3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc" gracePeriod=30 Jul 22 13:58:52.955280 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:52.955254 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:58:53.104327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.104293 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-tls-cert\") pod \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " Jul 22 13:58:53.104327 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.104335 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7snb\" (UniqueName: \"kubernetes.io/projected/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-kube-api-access-q7snb\") pod \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\" (UID: \"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc\") " Jul 22 13:58:53.106382 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.106354 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-kube-api-access-q7snb" (OuterVolumeSpecName: "kube-api-access-q7snb") pod "14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" (UID: "14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc"). InnerVolumeSpecName "kube-api-access-q7snb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:58:53.115130 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.115104 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" (UID: "14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:58:53.206100 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.206018 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-tls-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:58:53.206100 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.206055 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7snb\" (UniqueName: \"kubernetes.io/projected/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc-kube-api-access-q7snb\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:58:53.609320 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.609280 2556 generic.go:356] "Generic (PLEG): container finished" podID="14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" containerID="3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc" exitCode=0 Jul 22 13:58:53.609320 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.609323 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59468b5f4b-q9z54" Jul 22 13:58:53.609889 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.609364 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59468b5f4b-q9z54" event={"ID":"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc","Type":"ContainerDied","Data":"3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc"} Jul 22 13:58:53.609889 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.609409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59468b5f4b-q9z54" event={"ID":"14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc","Type":"ContainerDied","Data":"c1cfc736219fd93b8c0da0bb318e6f85ee757086373a0d74026fc0a29a562519"} Jul 22 13:58:53.609889 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.609433 2556 scope.go:117] "RemoveContainer" containerID="3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc" Jul 22 13:58:53.620928 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.620897 2556 scope.go:117] "RemoveContainer" containerID="3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc" Jul 22 13:58:53.621203 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:58:53.621174 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc\": container with ID starting with 3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc not found: ID does not exist" containerID="3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc" Jul 22 13:58:53.621299 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.621212 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc"} err="failed to get container status \"3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc\": rpc error: code = NotFound desc = could not find container \"3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc\": container with ID starting with 3d17c1218ccb928553fd0712ce82b8f81c0c7941eefddbd2a537d5faefd150fc not found: ID does not exist" Jul 22 13:58:53.633125 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.633096 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59468b5f4b-q9z54"] Jul 22 13:58:53.636160 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.636135 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59468b5f4b-q9z54"] Jul 22 13:58:53.822886 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:58:53.822844 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" path="/var/lib/kubelet/pods/14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc/volumes" Jul 22 13:59:14.025674 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:14.025641 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:59:14.106325 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:14.106289 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:59:19.142832 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:19.142793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 13:59:38.822785 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:38.822692 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-d224w"] Jul 22 13:59:38.823333 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:38.822991 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fdc48c68d-d224w" podUID="556831dc-cf11-49dd-8cf3-a33939fa9a91" containerName="manager" containerID="cri-o://3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0" gracePeriod=30 Jul 22 13:59:39.074152 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.074096 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:59:39.223829 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.223800 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfftg\" (UniqueName: \"kubernetes.io/projected/556831dc-cf11-49dd-8cf3-a33939fa9a91-kube-api-access-xfftg\") pod \"556831dc-cf11-49dd-8cf3-a33939fa9a91\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " Jul 22 13:59:39.224007 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.223867 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/556831dc-cf11-49dd-8cf3-a33939fa9a91-webhook-cert\") pod \"556831dc-cf11-49dd-8cf3-a33939fa9a91\" (UID: \"556831dc-cf11-49dd-8cf3-a33939fa9a91\") " Jul 22 13:59:39.225846 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.225812 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/556831dc-cf11-49dd-8cf3-a33939fa9a91-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "556831dc-cf11-49dd-8cf3-a33939fa9a91" (UID: "556831dc-cf11-49dd-8cf3-a33939fa9a91"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:59:39.225993 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.225890 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556831dc-cf11-49dd-8cf3-a33939fa9a91-kube-api-access-xfftg" (OuterVolumeSpecName: "kube-api-access-xfftg") pod "556831dc-cf11-49dd-8cf3-a33939fa9a91" (UID: "556831dc-cf11-49dd-8cf3-a33939fa9a91"). InnerVolumeSpecName "kube-api-access-xfftg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:59:39.324728 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.324662 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/556831dc-cf11-49dd-8cf3-a33939fa9a91-webhook-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:59:39.324728 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.324687 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfftg\" (UniqueName: \"kubernetes.io/projected/556831dc-cf11-49dd-8cf3-a33939fa9a91-kube-api-access-xfftg\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 13:59:39.868997 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.868961 2556 generic.go:356] "Generic (PLEG): container finished" podID="556831dc-cf11-49dd-8cf3-a33939fa9a91" containerID="3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0" exitCode=0 Jul 22 13:59:39.869402 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.869002 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-d224w" Jul 22 13:59:39.869402 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.869050 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-d224w" event={"ID":"556831dc-cf11-49dd-8cf3-a33939fa9a91","Type":"ContainerDied","Data":"3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0"} Jul 22 13:59:39.869402 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.869098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-d224w" event={"ID":"556831dc-cf11-49dd-8cf3-a33939fa9a91","Type":"ContainerDied","Data":"7f2b9fd7fd021d3be16c2b660c918c89be5bab71c101ba12d3471648837ab79f"} Jul 22 13:59:39.869402 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.869119 2556 scope.go:117] "RemoveContainer" containerID="3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0" Jul 22 13:59:39.878510 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.878495 2556 scope.go:117] "RemoveContainer" containerID="3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0" Jul 22 13:59:39.878767 ip-10-0-140-215 kubenswrapper[2556]: E0722 13:59:39.878752 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0\": container with ID starting with 3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0 not found: ID does not exist" containerID="3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0" Jul 22 13:59:39.878810 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.878778 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0"} err="failed to get container status \"3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0\": rpc error: code = NotFound desc = could not find container \"3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0\": container with ID starting with 3b5ca3a15c503d2bfb30361a981f9c3c5bc5ca85b73004c55bab18d18a3b40c0 not found: ID does not exist" Jul 22 13:59:39.888668 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.888645 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-d224w"] Jul 22 13:59:39.893739 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:39.893719 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-d224w"] Jul 22 13:59:41.823222 ip-10-0-140-215 kubenswrapper[2556]: I0722 13:59:41.823195 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556831dc-cf11-49dd-8cf3-a33939fa9a91" path="/var/lib/kubelet/pods/556831dc-cf11-49dd-8cf3-a33939fa9a91/volumes" Jul 22 14:01:00.180288 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:00.180251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:00.289374 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:00.289334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:01.409127 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:01.409079 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:13.773822 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:13.773744 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:01:13.774243 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:13.773951 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:01:21.642281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:21.642239 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:39.077087 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:39.077055 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:39.180937 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:39.180888 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:39.332264 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:39.332166 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:45.639574 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:45.639536 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:45.695491 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:45.695463 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:45.782524 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:45.782492 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:45.882438 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:45.882399 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:46.044899 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:46.044783 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:52.252323 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:52.252287 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:01:52.311152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:01:52.311120 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:03:50.915723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:03:50.915687 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:03:51.003849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:03:51.003820 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:06:13.813231 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:06:13.813179 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:06:13.815494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:06:13.815466 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:07:35.202728 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:07:35.202685 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:08:15.612272 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:08:15.612227 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:09:39.720464 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:09:39.720416 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:09:50.846721 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:09:50.846687 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:10:11.479710 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:10:11.479617 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:10:13.056428 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:10:13.056397 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:10:47.782668 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:10:47.782632 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:11:13.850042 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:11:13.850012 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:11:13.854505 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:11:13.854477 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:12:15.002337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:12:15.002299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:20.136475 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:20.136388 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:43.597625 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:43.597588 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:46.630164 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:46.630129 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:46.727133 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:46.727099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:47.059616 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:47.059528 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:53.175200 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.175157 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:53.277927 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.277869 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:53.423529 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.423499 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:53.727428 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727398 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44"] Jul 22 14:13:53.727773 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556831dc-cf11-49dd-8cf3-a33939fa9a91" containerName="manager" Jul 22 14:13:53.727820 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727774 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="556831dc-cf11-49dd-8cf3-a33939fa9a91" containerName="manager" Jul 22 14:13:53.727820 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727787 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" containerName="authorino" Jul 22 14:13:53.727820 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727793 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" containerName="authorino" Jul 22 14:13:53.727936 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727858 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f1dbbb-c1c4-4e1c-854e-99b7b4f11cbc" containerName="authorino" Jul 22 14:13:53.727936 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.727868 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="556831dc-cf11-49dd-8cf3-a33939fa9a91" containerName="manager" Jul 22 14:13:53.730962 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.730943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.733404 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.733390 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4c2bb423-openshift-default-dockercfg-r2r49\"" Jul 22 14:13:53.752217 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.752189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:53.754377 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.754351 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44"] Jul 22 14:13:53.854850 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.854816 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:53.860954 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.860933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-data\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861033 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.860970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhwqw\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-kube-api-access-zhwqw\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861033 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.860998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-credential-socket\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861123 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.861102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/287b3677-76f3-4543-97e5-206732dfe941-istio-podinfo\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861162 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.861132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-istio-token\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861162 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.861151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/287b3677-76f3-4543-97e5-206732dfe941-istiod-ca-cert\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861225 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.861194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-socket\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861267 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.861240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-envoy\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.861306 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.861283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-certs\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.961972 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.961934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-istio-token\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.961972 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.961973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/287b3677-76f3-4543-97e5-206732dfe941-istiod-ca-cert\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962189 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-socket\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962189 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-envoy\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962189 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-certs\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962189 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-data\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962391 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhwqw\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-kube-api-access-zhwqw\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962391 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-credential-socket\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962391 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962320 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/287b3677-76f3-4543-97e5-206732dfe941-istio-podinfo\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962554 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-socket\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.962851 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962822 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-data\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.963012 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-certs\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.963012 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962940 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-credential-socket\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.963012 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.962965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/287b3677-76f3-4543-97e5-206732dfe941-istiod-ca-cert\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.964809 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.964784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-envoy\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.964960 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.964943 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/287b3677-76f3-4543-97e5-206732dfe941-istio-podinfo\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.970651 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.970627 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-istio-token\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:53.970740 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:53.970692 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhwqw\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-kube-api-access-zhwqw\") pod \"e2e-ait-4c2bb423-openshift-default-db54c495-f7t44\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:54.040670 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.040586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:54.182632 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.182605 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44"] Jul 22 14:13:54.184791 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:13:54.184764 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287b3677_76f3_4543_97e5_206732dfe941.slice/crio-1104f5a6a2c9c71280fe9c28146972289dbe598d8fbe3b9b11154c53f4aeabaa WatchSource:0}: Error finding container 1104f5a6a2c9c71280fe9c28146972289dbe598d8fbe3b9b11154c53f4aeabaa: Status 404 returned error can't find the container with id 1104f5a6a2c9c71280fe9c28146972289dbe598d8fbe3b9b11154c53f4aeabaa Jul 22 14:13:54.186862 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.186827 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:13:54.186953 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.186926 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:13:54.187005 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.186964 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:13:54.561796 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.561763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" event={"ID":"287b3677-76f3-4543-97e5-206732dfe941","Type":"ContainerStarted","Data":"31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d"} Jul 22 14:13:54.561984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.561817 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" event={"ID":"287b3677-76f3-4543-97e5-206732dfe941","Type":"ContainerStarted","Data":"1104f5a6a2c9c71280fe9c28146972289dbe598d8fbe3b9b11154c53f4aeabaa"} Jul 22 14:13:54.583191 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:54.583145 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" podStartSLOduration=1.583131647 podStartE2EDuration="1.583131647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:13:54.58199394 +0000 UTC m=+1661.232009982" watchObservedRunningTime="2026-07-22 14:13:54.583131647 +0000 UTC m=+1661.233147687" Jul 22 14:13:55.040799 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:55.040759 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:55.045810 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:55.045787 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:55.567460 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:55.567418 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:55.568482 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:55.568461 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:13:55.938656 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:55.938625 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:56.031443 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.031411 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj"] Jul 22 14:13:56.032994 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.032967 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:56.035124 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.035108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.037522 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.037503 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4c2bb423-serving-cert\"" Jul 22 14:13:56.037620 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.037547 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\"" Jul 22 14:13:56.048583 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.048565 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj"] Jul 22 14:13:56.113838 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.113808 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:56.182076 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.182044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-openshift-service-ca\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.182250 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.182086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.182250 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.182168 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqjg\" (UniqueName: \"kubernetes.io/projected/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-kube-api-access-xnqjg\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.283600 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.283505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-openshift-service-ca\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.283600 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.283550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.283600 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.283586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqjg\" (UniqueName: \"kubernetes.io/projected/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-kube-api-access-xnqjg\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.283888 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:13:56.283718 2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-serving-cert: secret "maas-api-e2e-ait-4c2bb423-serving-cert" not found Jul 22 14:13:56.283888 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:13:56.283789 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls podName:99a1a7b6-c7ac-487d-9c69-4c6652f8de90 nodeName:}" failed. No retries permitted until 2026-07-22 14:13:56.783770411 +0000 UTC m=+1663.433786432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls") pod "maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" (UID: "99a1a7b6-c7ac-487d-9c69-4c6652f8de90") : secret "maas-api-e2e-ait-4c2bb423-serving-cert" not found Jul 22 14:13:56.284255 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.284233 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-openshift-service-ca\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.293616 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.293593 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqjg\" (UniqueName: \"kubernetes.io/projected/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-kube-api-access-xnqjg\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.637365 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.637325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:56.733710 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.733675 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:56.789216 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.789176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.791644 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.791617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls\") pod \"maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:56.837929 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.837872 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:13:56.945735 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:56.945645 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:57.083054 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:57.083021 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj"] Jul 22 14:13:57.084321 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:13:57.084292 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a1a7b6_c7ac_487d_9c69_4c6652f8de90.slice/crio-70fd131d23ffb3fcc3e194c8eeef6e3ad656470a46daff4da4ff68d3f7b26db8 WatchSource:0}: Error finding container 70fd131d23ffb3fcc3e194c8eeef6e3ad656470a46daff4da4ff68d3f7b26db8: Status 404 returned error can't find the container with id 70fd131d23ffb3fcc3e194c8eeef6e3ad656470a46daff4da4ff68d3f7b26db8 Jul 22 14:13:57.085772 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:57.085754 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 14:13:57.579309 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:57.579275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" event={"ID":"99a1a7b6-c7ac-487d-9c69-4c6652f8de90","Type":"ContainerStarted","Data":"70fd131d23ffb3fcc3e194c8eeef6e3ad656470a46daff4da4ff68d3f7b26db8"} Jul 22 14:13:59.596932 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:59.596415 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" event={"ID":"99a1a7b6-c7ac-487d-9c69-4c6652f8de90","Type":"ContainerStarted","Data":"8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba"} Jul 22 14:13:59.600930 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:59.597674 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:13:59.621236 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:13:59.621180 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" podStartSLOduration=1.470130427 podStartE2EDuration="3.621162993s" totalImagesPullingTime="2.151032566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:13:59.618336701 +0000 UTC m=+1666.268352742" watchObservedRunningTime="2026-07-22 14:13:59.621162993 +0000 UTC m=+1666.271179032" Jul 22 14:14:06.612389 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:06.612363 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:14:07.643895 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:07.643863 2556 generic.go:356] "Generic (PLEG): container finished" podID="287b3677-76f3-4543-97e5-206732dfe941" containerID="31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d" exitCode=0 Jul 22 14:14:07.644300 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:07.643947 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" event={"ID":"287b3677-76f3-4543-97e5-206732dfe941","Type":"ContainerDied","Data":"31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d"} Jul 22 14:14:07.644342 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:07.644331 2556 scope.go:117] "RemoveContainer" containerID="31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d" Jul 22 14:14:07.645438 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:07.645409 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:07.645525 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:07.645510 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:07.645567 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:07.645551 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:08.650868 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:08.650835 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" event={"ID":"287b3677-76f3-4543-97e5-206732dfe941","Type":"ContainerStarted","Data":"2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0"} Jul 22 14:14:09.041730 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:09.041640 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:14:09.042897 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:09.042874 2556 patch_prober.go:28] interesting pod/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 22 14:14:09.042960 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:09.042944 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 22 14:14:10.042025 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:10.041988 2556 patch_prober.go:28] interesting pod/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 22 14:14:10.042441 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:10.042046 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 22 14:14:10.567831 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:10.567775 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:14:11.041760 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:11.041719 2556 patch_prober.go:28] interesting pod/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 22 14:14:11.041938 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:11.041780 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 22 14:14:12.041833 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:12.041798 2556 patch_prober.go:28] interesting pod/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 22 14:14:12.042245 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:12.041850 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 22 14:14:13.044867 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:13.044834 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:14:13.045878 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:13.045856 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:14:32.088255 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.088216 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj"] Jul 22 14:14:32.088824 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.088488 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" podUID="99a1a7b6-c7ac-487d-9c69-4c6652f8de90" containerName="maas-api" containerID="cri-o://8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba" gracePeriod=30 Jul 22 14:14:32.119094 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.119046 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:32.345103 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.345082 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:14:32.409145 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.409113 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnqjg\" (UniqueName: \"kubernetes.io/projected/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-kube-api-access-xnqjg\") pod \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " Jul 22 14:14:32.409335 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.409203 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls\") pod \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " Jul 22 14:14:32.409335 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.409244 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-openshift-service-ca\") pod \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\" (UID: \"99a1a7b6-c7ac-487d-9c69-4c6652f8de90\") " Jul 22 14:14:32.409599 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.409574 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99a1a7b6-c7ac-487d-9c69-4c6652f8de90" (UID: "99a1a7b6-c7ac-487d-9c69-4c6652f8de90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:14:32.411461 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.411437 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99a1a7b6-c7ac-487d-9c69-4c6652f8de90" (UID: "99a1a7b6-c7ac-487d-9c69-4c6652f8de90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 14:14:32.411569 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.411500 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-kube-api-access-xnqjg" (OuterVolumeSpecName: "kube-api-access-xnqjg") pod "99a1a7b6-c7ac-487d-9c69-4c6652f8de90" (UID: "99a1a7b6-c7ac-487d-9c69-4c6652f8de90"). InnerVolumeSpecName "kube-api-access-xnqjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:14:32.510877 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.510836 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnqjg\" (UniqueName: \"kubernetes.io/projected/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-kube-api-access-xnqjg\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:32.510877 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.510873 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-maas-api-tls\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:32.510877 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.510885 2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99a1a7b6-c7ac-487d-9c69-4c6652f8de90-openshift-service-ca\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:32.788659 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.788566 2556 generic.go:356] "Generic (PLEG): container finished" podID="99a1a7b6-c7ac-487d-9c69-4c6652f8de90" containerID="8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba" exitCode=0 Jul 22 14:14:32.788659 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.788607 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" Jul 22 14:14:32.788846 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.788610 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" event={"ID":"99a1a7b6-c7ac-487d-9c69-4c6652f8de90","Type":"ContainerDied","Data":"8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba"} Jul 22 14:14:32.788846 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.788736 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj" event={"ID":"99a1a7b6-c7ac-487d-9c69-4c6652f8de90","Type":"ContainerDied","Data":"70fd131d23ffb3fcc3e194c8eeef6e3ad656470a46daff4da4ff68d3f7b26db8"} Jul 22 14:14:32.788846 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.788765 2556 scope.go:117] "RemoveContainer" containerID="8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba" Jul 22 14:14:32.798721 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.798699 2556 scope.go:117] "RemoveContainer" containerID="8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba" Jul 22 14:14:32.799029 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:14:32.799011 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba\": container with ID starting with 8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba not found: ID does not exist" containerID="8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba" Jul 22 14:14:32.799094 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.799038 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba"} err="failed to get container status \"8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba\": rpc error: code = NotFound desc = could not find container \"8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba\": container with ID starting with 8dae034101f4727017e8f230a67ba38d834c2d78f67f3602cc7dfdd0a99deaba not found: ID does not exist" Jul 22 14:14:32.812740 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.812713 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj"] Jul 22 14:14:32.815135 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:32.815108 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c2bb423-6676f55fbd-v4zqj"] Jul 22 14:14:33.822452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:33.822417 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a1a7b6-c7ac-487d-9c69-4c6652f8de90" path="/var/lib/kubelet/pods/99a1a7b6-c7ac-487d-9c69-4c6652f8de90/volumes" Jul 22 14:14:36.640601 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:36.640518 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:36.797726 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:36.797698 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44"] Jul 22 14:14:36.797929 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:36.797891 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" containerID="cri-o://2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0" gracePeriod=30 Jul 22 14:14:36.816350 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:36.816311 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:37.074395 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.074309 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:37.354978 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.354943 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:37.444005 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.443974 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:37.613498 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.613410 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:37.925552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.925457 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8"] Jul 22 14:14:37.926056 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.925829 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a1a7b6-c7ac-487d-9c69-4c6652f8de90" containerName="maas-api" Jul 22 14:14:37.926056 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.925839 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a1a7b6-c7ac-487d-9c69-4c6652f8de90" containerName="maas-api" Jul 22 14:14:37.926056 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.925933 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a1a7b6-c7ac-487d-9c69-4c6652f8de90" containerName="maas-api" Jul 22 14:14:37.928483 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.928465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:37.931041 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.931019 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-592a7c5a-gw-openshift-default-dockercfg-tphpr\"" Jul 22 14:14:37.943102 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.943077 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8"] Jul 22 14:14:37.948242 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:37.948205 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:38.045656 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.045623 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:38.059753 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.059719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-certs\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.059890 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.059756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-data\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.059890 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.059777 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-envoy\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.059890 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.059861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-socket\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.060029 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.059985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-token\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.060064 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.060034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-credential-socket\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.060064 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.060056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2kw7\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-kube-api-access-f2kw7\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.060126 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.060076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-podinfo\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.060126 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.060091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istiod-ca-cert\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161377 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-credential-socket\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161377 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2kw7\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-kube-api-access-f2kw7\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-podinfo\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istiod-ca-cert\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-certs\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161498 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-data\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-envoy\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-socket\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.161654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-token\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.162032 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-credential-socket\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.162032 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.161965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-certs\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.162032 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.162022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-data\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.162185 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.162164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-socket\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.162308 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.162270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istiod-ca-cert\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.163792 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.163765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-envoy\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.164084 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.164068 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-podinfo\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.169820 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.169793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2kw7\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-kube-api-access-f2kw7\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.170067 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.170041 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-token\") pod \"e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.238372 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.238279 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:38.384311 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.384279 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8"] Jul 22 14:14:38.386986 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:14:38.386957 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0211df51_e12f_40eb_a83d_d242ba2d1b0f.slice/crio-79b169af4cce23ff382686cabfd26d3549b0f52f8b65c5b39d28b98143acdc50 WatchSource:0}: Error finding container 79b169af4cce23ff382686cabfd26d3549b0f52f8b65c5b39d28b98143acdc50: Status 404 returned error can't find the container with id 79b169af4cce23ff382686cabfd26d3549b0f52f8b65c5b39d28b98143acdc50 Jul 22 14:14:38.389159 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.389117 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:38.389277 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.389199 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:38.389277 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.389230 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:38.825018 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.824979 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" event={"ID":"0211df51-e12f-40eb-a83d-d242ba2d1b0f","Type":"ContainerStarted","Data":"2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be"} Jul 22 14:14:38.825214 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.825073 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" event={"ID":"0211df51-e12f-40eb-a83d-d242ba2d1b0f","Type":"ContainerStarted","Data":"79b169af4cce23ff382686cabfd26d3549b0f52f8b65c5b39d28b98143acdc50"} Jul 22 14:14:38.851798 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:38.851737 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podStartSLOduration=1.851721065 podStartE2EDuration="1.851721065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:14:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:14:38.849977925 +0000 UTC m=+1705.499993985" watchObservedRunningTime="2026-07-22 14:14:38.851721065 +0000 UTC m=+1705.501737104" Jul 22 14:14:39.238860 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:39.238828 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:39.244001 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:39.243975 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:39.830694 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:39.830653 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:39.831762 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:39.831740 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:40.335739 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:40.335706 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:40.592723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:40.592692 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:40.722551 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:40.722520 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:41.069864 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:41.069783 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:41.169869 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:41.169837 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:14:42.043769 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.043749 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:14:42.204405 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204368 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/287b3677-76f3-4543-97e5-206732dfe941-istio-podinfo\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204418 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-certs\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204460 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-data\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204560 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-credential-socket\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204598 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-envoy\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204624 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhwqw\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-kube-api-access-zhwqw\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204669 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-istio-token\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204722 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/287b3677-76f3-4543-97e5-206732dfe941-istiod-ca-cert\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204747 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-socket\") pod \"287b3677-76f3-4543-97e5-206732dfe941\" (UID: \"287b3677-76f3-4543-97e5-206732dfe941\") " Jul 22 14:14:42.204832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204775 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:14:42.205123 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.204877 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:14:42.205174 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.205158 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.205225 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.205177 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.205286 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.205225 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287b3677-76f3-4543-97e5-206732dfe941-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:14:42.205381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.205350 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:14:42.205523 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.205463 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-data" (OuterVolumeSpecName: "istio-data") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:14:42.206948 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.206902 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:14:42.206948 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.206935 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/287b3677-76f3-4543-97e5-206732dfe941-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:14:42.207078 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.207009 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-istio-token" (OuterVolumeSpecName: "istio-token") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:14:42.207078 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.207039 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-kube-api-access-zhwqw" (OuterVolumeSpecName: "kube-api-access-zhwqw") pod "287b3677-76f3-4543-97e5-206732dfe941" (UID: "287b3677-76f3-4543-97e5-206732dfe941"). InnerVolumeSpecName "kube-api-access-zhwqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:14:42.306278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306236 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.306278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306272 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/287b3677-76f3-4543-97e5-206732dfe941-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.306278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306281 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.306278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306291 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/287b3677-76f3-4543-97e5-206732dfe941-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.306562 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306300 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.306562 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306308 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/287b3677-76f3-4543-97e5-206732dfe941-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.306562 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.306317 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhwqw\" (UniqueName: \"kubernetes.io/projected/287b3677-76f3-4543-97e5-206732dfe941-kube-api-access-zhwqw\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:14:42.849159 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.849127 2556 generic.go:356] "Generic (PLEG): container finished" podID="287b3677-76f3-4543-97e5-206732dfe941" containerID="2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0" exitCode=0 Jul 22 14:14:42.849370 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.849182 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" Jul 22 14:14:42.849370 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.849206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" event={"ID":"287b3677-76f3-4543-97e5-206732dfe941","Type":"ContainerDied","Data":"2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0"} Jul 22 14:14:42.849370 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.849272 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44" event={"ID":"287b3677-76f3-4543-97e5-206732dfe941","Type":"ContainerDied","Data":"1104f5a6a2c9c71280fe9c28146972289dbe598d8fbe3b9b11154c53f4aeabaa"} Jul 22 14:14:42.849370 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.849323 2556 scope.go:117] "RemoveContainer" containerID="2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0" Jul 22 14:14:42.859763 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.859744 2556 scope.go:117] "RemoveContainer" containerID="31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d" Jul 22 14:14:42.868453 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.868431 2556 scope.go:117] "RemoveContainer" containerID="2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0" Jul 22 14:14:42.868757 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:14:42.868731 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0\": container with ID starting with 2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0 not found: ID does not exist" containerID="2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0" Jul 22 14:14:42.868849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.868769 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0"} err="failed to get container status \"2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0\": rpc error: code = NotFound desc = could not find container \"2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0\": container with ID starting with 2b55a639d7a2bc196d21a47972749d0d56eec917736f539be85398c8c16073e0 not found: ID does not exist" Jul 22 14:14:42.868849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.868793 2556 scope.go:117] "RemoveContainer" containerID="31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d" Jul 22 14:14:42.869206 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:14:42.869185 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d\": container with ID starting with 31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d not found: ID does not exist" containerID="31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d" Jul 22 14:14:42.869342 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.869217 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d"} err="failed to get container status \"31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d\": rpc error: code = NotFound desc = could not find container \"31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d\": container with ID starting with 31f683159c9afb8f1e04277094cadc96011dc61793e9ddf3f96d0e499497434d not found: ID does not exist" Jul 22 14:14:42.878428 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.874973 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44"] Jul 22 14:14:42.880898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:42.880871 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4c2bb423-openshift-default-db54c495-f7t44"] Jul 22 14:14:43.825986 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:43.825954 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287b3677-76f3-4543-97e5-206732dfe941" path="/var/lib/kubelet/pods/287b3677-76f3-4543-97e5-206732dfe941/volumes" Jul 22 14:14:55.071773 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.071502 2556 patch_prober.go:28] interesting pod/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:40700->10.132.0.59:15021: read: connection reset by peer" start-of-body= Jul 22 14:14:55.071773 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.071593 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:40700->10.132.0.59:15021: read: connection reset by peer" Jul 22 14:14:55.924593 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.924560 2556 generic.go:356] "Generic (PLEG): container finished" podID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerID="2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be" exitCode=0 Jul 22 14:14:55.924836 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.924635 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" event={"ID":"0211df51-e12f-40eb-a83d-d242ba2d1b0f","Type":"ContainerDied","Data":"2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be"} Jul 22 14:14:55.925080 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.925066 2556 scope.go:117] "RemoveContainer" containerID="2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be" Jul 22 14:14:55.926130 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.926103 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:55.926205 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.926183 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:55.926254 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:55.926223 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:14:56.932780 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:56.932742 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" event={"ID":"0211df51-e12f-40eb-a83d-d242ba2d1b0f","Type":"ContainerStarted","Data":"f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48"} Jul 22 14:14:57.238531 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:57.238438 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:14:57.238688 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:57.238622 2556 patch_prober.go:28] interesting pod/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 22 14:14:57.238688 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:57.238672 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 22 14:14:58.239507 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:58.239467 2556 patch_prober.go:28] interesting pod/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 22 14:14:58.239970 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:58.239526 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 22 14:14:59.239070 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:59.239034 2556 patch_prober.go:28] interesting pod/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 22 14:14:59.239273 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:14:59.239091 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 22 14:15:00.239515 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:00.239480 2556 patch_prober.go:28] interesting pod/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 22 14:15:00.239947 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:00.239536 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 22 14:15:01.242735 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:01.242705 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:15:01.243220 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:01.243011 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:15:01.243740 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:01.243723 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:15:15.868766 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:15.868725 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:20.460536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:20.460500 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:20.601215 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:20.601174 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8"] Jul 22 14:15:20.601502 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:20.601454 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" containerID="cri-o://f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48" gracePeriod=30 Jul 22 14:15:20.625857 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:20.625819 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:20.858163 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:20.858129 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:21.099206 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.099168 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:21.410991 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.410953 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw"] Jul 22 14:15:21.411399 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.411387 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" Jul 22 14:15:21.411452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.411401 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" Jul 22 14:15:21.411452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.411418 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" Jul 22 14:15:21.411452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.411424 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" Jul 22 14:15:21.411547 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.411513 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" Jul 22 14:15:21.411547 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.411521 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="287b3677-76f3-4543-97e5-206732dfe941" containerName="istio-proxy" Jul 22 14:15:21.413492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.413476 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.416260 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.416241 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b2bcc8b0-openshift-default-dockercfg-zqck2\"" Jul 22 14:15:21.429558 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.429524 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw"] Jul 22 14:15:21.439387 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.439351 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:21.485890 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.485848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-certs\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.485904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-socket\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.485994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-podinfo\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.486036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-token\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.486101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istiod-ca-cert\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.486145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-data\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.486247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-credential-socket\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.486265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-envoy\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.486381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.486288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88v6s\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-kube-api-access-88v6s\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.586856 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.586813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-credential-socket\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.586856 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.586857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-envoy\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.586895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88v6s\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-kube-api-access-88v6s\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.586990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-certs\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-socket\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-podinfo\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-token\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587394 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istiod-ca-cert\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587394 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-data\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587394 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587302 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-credential-socket\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587946 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587659 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-certs\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.587946 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.587876 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:21.588145 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.588010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istiod-ca-cert\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.588145 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.588053 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-socket\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.588243 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.588161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-data\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.589615 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.589594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-envoy\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.590013 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.589991 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-podinfo\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.596271 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.596235 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-token\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.596456 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.596434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88v6s\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-kube-api-access-88v6s\") pod \"e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.723881 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.723778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:21.910628 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.910592 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw"] Jul 22 14:15:21.912572 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:15:21.912542 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71c4022_8182_43d8_9b5e_791e1ec3b1e2.slice/crio-db71f72b6250bc88ad1840fa8616ccc288e533dd3bc882287971096fefa01644 WatchSource:0}: Error finding container db71f72b6250bc88ad1840fa8616ccc288e533dd3bc882287971096fefa01644: Status 404 returned error can't find the container with id db71f72b6250bc88ad1840fa8616ccc288e533dd3bc882287971096fefa01644 Jul 22 14:15:21.914973 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.914934 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:15:21.915071 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.915016 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:15:21.915071 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:21.915047 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:15:22.088574 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:22.088481 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" event={"ID":"a71c4022-8182-43d8-9b5e-791e1ec3b1e2","Type":"ContainerStarted","Data":"6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9"} Jul 22 14:15:22.088574 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:22.088545 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" event={"ID":"a71c4022-8182-43d8-9b5e-791e1ec3b1e2","Type":"ContainerStarted","Data":"db71f72b6250bc88ad1840fa8616ccc288e533dd3bc882287971096fefa01644"} Jul 22 14:15:22.111035 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:22.110984 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podStartSLOduration=1.110967705 podStartE2EDuration="1.110967705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:15:22.108092844 +0000 UTC m=+1748.758108926" watchObservedRunningTime="2026-07-22 14:15:22.110967705 +0000 UTC m=+1748.760983745" Jul 22 14:15:22.724005 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:22.723965 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:22.725533 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:22.725504 2556 patch_prober.go:28] interesting pod/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 22 14:15:22.725680 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:22.725559 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 22 14:15:23.728301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:23.728266 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:24.101156 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:24.101126 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:24.102297 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:24.102272 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:25.098824 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:25.098792 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:25.154450 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:25.154411 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:15:25.863065 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:25.862993 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:15:26.034095 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034058 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2kw7\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-kube-api-access-f2kw7\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034103 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istiod-ca-cert\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034133 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-envoy\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034151 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-data\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034202 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-podinfo\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034242 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-credential-socket\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034269 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-token\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034308 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-certs\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034677 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034375 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-socket\") pod \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\" (UID: \"0211df51-e12f-40eb-a83d-d242ba2d1b0f\") " Jul 22 14:15:26.034677 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034563 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:15:26.034784 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034767 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:15:26.035023 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034894 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.035023 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034937 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.035023 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034958 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:15:26.035023 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.034977 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:15:26.035320 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.035198 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:15:26.036951 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.036888 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:15:26.036951 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.036904 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-kube-api-access-f2kw7" (OuterVolumeSpecName: "kube-api-access-f2kw7") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "kube-api-access-f2kw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:15:26.037142 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.037044 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:15:26.037142 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.037072 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0211df51-e12f-40eb-a83d-d242ba2d1b0f" (UID: "0211df51-e12f-40eb-a83d-d242ba2d1b0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:15:26.123507 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.123413 2556 generic.go:356] "Generic (PLEG): container finished" podID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerID="f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48" exitCode=0 Jul 22 14:15:26.123507 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.123471 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" Jul 22 14:15:26.123507 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.123484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" event={"ID":"0211df51-e12f-40eb-a83d-d242ba2d1b0f","Type":"ContainerDied","Data":"f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48"} Jul 22 14:15:26.124084 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.123564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8" event={"ID":"0211df51-e12f-40eb-a83d-d242ba2d1b0f","Type":"ContainerDied","Data":"79b169af4cce23ff382686cabfd26d3549b0f52f8b65c5b39d28b98143acdc50"} Jul 22 14:15:26.124084 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.123586 2556 scope.go:117] "RemoveContainer" containerID="f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48" Jul 22 14:15:26.133920 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.133882 2556 scope.go:117] "RemoveContainer" containerID="2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be" Jul 22 14:15:26.135380 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135356 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.135380 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135378 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.135559 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135390 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.135559 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135399 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.135559 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135407 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2kw7\" (UniqueName: \"kubernetes.io/projected/0211df51-e12f-40eb-a83d-d242ba2d1b0f-kube-api-access-f2kw7\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.135559 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135419 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.135559 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.135429 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0211df51-e12f-40eb-a83d-d242ba2d1b0f-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:15:26.143152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.143134 2556 scope.go:117] "RemoveContainer" containerID="f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48" Jul 22 14:15:26.143440 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:15:26.143410 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48\": container with ID starting with f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48 not found: ID does not exist" containerID="f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48" Jul 22 14:15:26.143512 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.143454 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48"} err="failed to get container status \"f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48\": rpc error: code = NotFound desc = could not find container \"f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48\": container with ID starting with f9d3bf4c9c906dcfd428c9bddf0e18fc55ddf2fa04dc4eba7c8bf002c8d41e48 not found: ID does not exist" Jul 22 14:15:26.143512 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.143482 2556 scope.go:117] "RemoveContainer" containerID="2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be" Jul 22 14:15:26.143774 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:15:26.143755 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be\": container with ID starting with 2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be not found: ID does not exist" containerID="2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be" Jul 22 14:15:26.143817 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.143781 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be"} err="failed to get container status \"2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be\": rpc error: code = NotFound desc = could not find container \"2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be\": container with ID starting with 2444ca3f8ac8a67fb63c73888da2acb6d459a944a2ae22ba26e99fc60ff141be not found: ID does not exist" Jul 22 14:15:26.149622 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.149596 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8"] Jul 22 14:15:26.154658 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:26.154630 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-592a7c5a-gw-openshift-default-59f87877cf-8fpz8"] Jul 22 14:15:27.822567 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:27.822521 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" path="/var/lib/kubelet/pods/0211df51-e12f-40eb-a83d-d242ba2d1b0f/volumes" Jul 22 14:15:39.610761 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:39.609632 2556 patch_prober.go:28] interesting pod/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:60778->10.132.0.60:15021: read: connection reset by peer" start-of-body= Jul 22 14:15:39.610761 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:39.609690 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:60778->10.132.0.60:15021: read: connection reset by peer" Jul 22 14:15:40.238849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:40.238812 2556 generic.go:356] "Generic (PLEG): container finished" podID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerID="6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9" exitCode=0 Jul 22 14:15:40.239100 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:40.238890 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" event={"ID":"a71c4022-8182-43d8-9b5e-791e1ec3b1e2","Type":"ContainerDied","Data":"6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9"} Jul 22 14:15:40.239421 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:40.239402 2556 scope.go:117] "RemoveContainer" containerID="6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9" Jul 22 14:15:40.240479 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:40.240450 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:15:40.240537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:40.240522 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:15:40.240576 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:40.240557 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:15:41.246648 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:41.246604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" event={"ID":"a71c4022-8182-43d8-9b5e-791e1ec3b1e2","Type":"ContainerStarted","Data":"ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb"} Jul 22 14:15:41.724684 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:41.724649 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:41.724891 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:41.724866 2556 patch_prober.go:28] interesting pod/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 22 14:15:41.724985 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:41.724940 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 22 14:15:42.724976 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:42.724898 2556 patch_prober.go:28] interesting pod/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 22 14:15:42.725471 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:42.725003 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 22 14:15:43.724739 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:43.724696 2556 patch_prober.go:28] interesting pod/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 22 14:15:43.725009 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:43.724754 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 22 14:15:44.725127 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:44.725087 2556 patch_prober.go:28] interesting pod/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 22 14:15:44.725664 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:44.725161 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 22 14:15:45.727634 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:45.727600 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:45.728158 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:45.727893 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:45.728830 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:45.728812 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:15:59.700842 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:15:59.700803 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:04.323275 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:04.323242 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:05.538547 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:05.538468 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw"] Jul 22 14:16:05.538957 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:05.538764 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" containerID="cri-o://ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb" gracePeriod=30 Jul 22 14:16:05.564479 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:05.564445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:05.809865 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:05.809761 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:06.038699 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.038650 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:06.345674 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.345638 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp"] Jul 22 14:16:06.346061 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.346048 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" Jul 22 14:16:06.346114 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.346063 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" Jul 22 14:16:06.346151 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.346135 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" Jul 22 14:16:06.349425 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.349408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.351650 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.351629 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a098ef76-openshift-default-dockercfg-vlx9q\"" Jul 22 14:16:06.366713 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.366685 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp"] Jul 22 14:16:06.378101 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.378064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:06.403719 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-token\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.403887 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-podinfo\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.403887 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-socket\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.403887 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-envoy\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.403887 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403847 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlrdr\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-kube-api-access-tlrdr\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.403887 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-credential-socket\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.404078 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istiod-ca-cert\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.404078 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-certs\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.404078 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.403989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-data\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505435 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-data\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-token\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505510 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-podinfo\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-socket\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-envoy\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlrdr\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-kube-api-access-tlrdr\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505866 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-credential-socket\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.505866 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-data\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.506030 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istiod-ca-cert\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.506030 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-certs\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.506030 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.505959 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-socket\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.506030 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.506017 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-credential-socket\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.506231 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.506223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-certs\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.506448 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.506428 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istiod-ca-cert\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.507896 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.507874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-envoy\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.508059 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.508043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-podinfo\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.515831 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.515808 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlrdr\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-kube-api-access-tlrdr\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.516199 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.516183 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-token\") pod \"e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.643260 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.643151 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:06.660167 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.660138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:06.803999 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.803969 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp"] Jul 22 14:16:06.805838 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:16:06.805808 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2881c81_ccc0_4702_a242_5a510f7b3b1a.slice/crio-7e3ccd4e735b6ecbf5194c1078e9d67af1a51f7f867b95bcd32b6b1ae9022ecd WatchSource:0}: Error finding container 7e3ccd4e735b6ecbf5194c1078e9d67af1a51f7f867b95bcd32b6b1ae9022ecd: Status 404 returned error can't find the container with id 7e3ccd4e735b6ecbf5194c1078e9d67af1a51f7f867b95bcd32b6b1ae9022ecd Jul 22 14:16:06.808004 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.807961 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:16:06.808128 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.808048 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:16:06.808128 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:06.808098 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:16:07.401330 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:07.401298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" event={"ID":"f2881c81-ccc0-4702-a242-5a510f7b3b1a","Type":"ContainerStarted","Data":"df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438"} Jul 22 14:16:07.401526 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:07.401350 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" event={"ID":"f2881c81-ccc0-4702-a242-5a510f7b3b1a","Type":"ContainerStarted","Data":"7e3ccd4e735b6ecbf5194c1078e9d67af1a51f7f867b95bcd32b6b1ae9022ecd"} Jul 22 14:16:07.422529 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:07.422467 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podStartSLOduration=1.422445948 podStartE2EDuration="1.422445948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:16:07.42158334 +0000 UTC m=+1794.071599379" watchObservedRunningTime="2026-07-22 14:16:07.422445948 +0000 UTC m=+1794.072461989" Jul 22 14:16:07.660674 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:07.660579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:07.665647 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:07.665621 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:08.406706 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:08.406671 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:08.407876 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:08.407857 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:08.774979 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:08.774870 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:08.859613 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:08.859579 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:09.058825 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:09.058726 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:09.556241 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:09.556207 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:09.655833 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:09.655796 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:10.797710 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.797686 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:16:10.946651 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946618 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istiod-ca-cert\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.946835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946683 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88v6s\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-kube-api-access-88v6s\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.946835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946778 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-socket\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.946835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946812 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-podinfo\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.946835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946829 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-token\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.947105 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946856 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-certs\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.947105 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946878 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-data\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.947105 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.946966 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-envoy\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.947105 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947041 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-credential-socket\") pod \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\" (UID: \"a71c4022-8182-43d8-9b5e-791e1ec3b1e2\") " Jul 22 14:16:10.947318 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947107 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:10.947318 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947114 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:16:10.947318 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947223 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:10.947487 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947464 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:10.947603 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947583 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:10.947682 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947607 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:10.947682 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947623 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:10.947682 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.947636 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:10.948148 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.948124 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:10.949135 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.949107 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:16:10.949244 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.949225 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:10.949400 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.949383 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-kube-api-access-88v6s" (OuterVolumeSpecName: "kube-api-access-88v6s") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "kube-api-access-88v6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:16:10.949566 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:10.949553 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a71c4022-8182-43d8-9b5e-791e1ec3b1e2" (UID: "a71c4022-8182-43d8-9b5e-791e1ec3b1e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:16:11.049124 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.049090 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88v6s\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-kube-api-access-88v6s\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:11.049124 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.049119 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:11.049124 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.049129 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:11.049378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.049137 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:11.049378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.049146 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71c4022-8182-43d8-9b5e-791e1ec3b1e2-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:11.425111 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.425084 2556 generic.go:356] "Generic (PLEG): container finished" podID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerID="ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb" exitCode=0 Jul 22 14:16:11.425269 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.425145 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" Jul 22 14:16:11.425269 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.425169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" event={"ID":"a71c4022-8182-43d8-9b5e-791e1ec3b1e2","Type":"ContainerDied","Data":"ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb"} Jul 22 14:16:11.425269 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.425221 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw" event={"ID":"a71c4022-8182-43d8-9b5e-791e1ec3b1e2","Type":"ContainerDied","Data":"db71f72b6250bc88ad1840fa8616ccc288e533dd3bc882287971096fefa01644"} Jul 22 14:16:11.425269 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.425243 2556 scope.go:117] "RemoveContainer" containerID="ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb" Jul 22 14:16:11.435389 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.435370 2556 scope.go:117] "RemoveContainer" containerID="6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9" Jul 22 14:16:11.445160 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.445137 2556 scope.go:117] "RemoveContainer" containerID="ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb" Jul 22 14:16:11.445440 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:16:11.445421 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb\": container with ID starting with ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb not found: ID does not exist" containerID="ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb" Jul 22 14:16:11.445523 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.445448 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb"} err="failed to get container status \"ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb\": rpc error: code = NotFound desc = could not find container \"ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb\": container with ID starting with ff7a00b1b71e3f7229b8135f4ac1ca42551f7217cb9151029c5a1b71982c1cfb not found: ID does not exist" Jul 22 14:16:11.445523 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.445466 2556 scope.go:117] "RemoveContainer" containerID="6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9" Jul 22 14:16:11.445696 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:16:11.445674 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9\": container with ID starting with 6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9 not found: ID does not exist" containerID="6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9" Jul 22 14:16:11.445761 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.445702 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9"} err="failed to get container status \"6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9\": rpc error: code = NotFound desc = could not find container \"6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9\": container with ID starting with 6b536e0bbf6e0557cf376430660182a2733295df20f7fb634b5f9af47ea0d5a9 not found: ID does not exist" Jul 22 14:16:11.454099 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.454075 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw"] Jul 22 14:16:11.458468 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.458443 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b2bcc8b0-openshift-default-7f5dc8c6f9-7xlrw"] Jul 22 14:16:11.822049 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:11.821968 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" path="/var/lib/kubelet/pods/a71c4022-8182-43d8-9b5e-791e1ec3b1e2/volumes" Jul 22 14:16:13.886239 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:13.886205 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:16:13.894108 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:13.894082 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:16:23.408010 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.407966 2556 patch_prober.go:28] interesting pod/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 22 14:16:23.408444 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.408026 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 22 14:16:23.502534 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.502500 2556 generic.go:356] "Generic (PLEG): container finished" podID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerID="df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438" exitCode=0 Jul 22 14:16:23.502723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.502569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" event={"ID":"f2881c81-ccc0-4702-a242-5a510f7b3b1a","Type":"ContainerDied","Data":"df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438"} Jul 22 14:16:23.503007 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.502992 2556 scope.go:117] "RemoveContainer" containerID="df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438" Jul 22 14:16:23.504031 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.504004 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:16:23.504100 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.504072 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:16:23.504135 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:23.504105 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:16:24.510325 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:24.510292 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" event={"ID":"f2881c81-ccc0-4702-a242-5a510f7b3b1a","Type":"ContainerStarted","Data":"f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074"} Jul 22 14:16:24.660624 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:24.660574 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:24.661008 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:24.660977 2556 patch_prober.go:28] interesting pod/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 22 14:16:24.661122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:24.661045 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 22 14:16:25.661284 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:25.661242 2556 patch_prober.go:28] interesting pod/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 22 14:16:25.661880 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:25.661846 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 22 14:16:26.536166 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:26.536134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:26.637495 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:26.637450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:26.661012 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:26.660967 2556 patch_prober.go:28] interesting pod/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 22 14:16:26.661236 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:26.661042 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 22 14:16:27.661141 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:27.661096 2556 patch_prober.go:28] interesting pod/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 22 14:16:27.661633 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:27.661163 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 22 14:16:28.664695 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:28.664659 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:28.665177 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:28.664953 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:28.665739 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:28.665723 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:31.423446 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:31.423411 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:31.524013 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:31.523977 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:44.235319 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:44.235281 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:48.744014 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:48.743975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:48.893405 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:48.893369 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp"] Jul 22 14:16:48.893666 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:48.893632 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" containerID="cri-o://f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074" gracePeriod=30 Jul 22 14:16:48.917329 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:48.917282 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:49.154265 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:49.154233 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:50.794375 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:50.794336 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:50.894394 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:50.894359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:51.256874 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:51.256832 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:54.157267 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.157197 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:54.239850 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.239812 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-envoy\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.239850 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.239852 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istiod-ca-cert\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.239875 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-data\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.239980 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlrdr\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-kube-api-access-tlrdr\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240032 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-certs\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240059 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-podinfo\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240097 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-socket\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240418 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240160 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-credential-socket\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240418 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240216 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-token\") pod \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\" (UID: \"f2881c81-ccc0-4702-a242-5a510f7b3b1a\") " Jul 22 14:16:54.240418 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240339 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240339 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240487 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240669 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240691 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240689 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240707 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.241146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.240818 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:54.242463 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.242432 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:16:54.242463 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.242446 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-kube-api-access-tlrdr" (OuterVolumeSpecName: "kube-api-access-tlrdr") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "kube-api-access-tlrdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:16:54.242657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.242570 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:16:54.242710 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.242651 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2881c81-ccc0-4702-a242-5a510f7b3b1a" (UID: "f2881c81-ccc0-4702-a242-5a510f7b3b1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:16:54.341265 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.341228 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlrdr\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-kube-api-access-tlrdr\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.341265 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.341261 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.341487 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.341276 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.341487 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.341288 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.341487 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.341300 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.341487 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.341313 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2881c81-ccc0-4702-a242-5a510f7b3b1a-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:16:54.677040 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.677006 2556 generic.go:356] "Generic (PLEG): container finished" podID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerID="f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074" exitCode=0 Jul 22 14:16:54.677231 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.677052 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" event={"ID":"f2881c81-ccc0-4702-a242-5a510f7b3b1a","Type":"ContainerDied","Data":"f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074"} Jul 22 14:16:54.677231 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.677092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" event={"ID":"f2881c81-ccc0-4702-a242-5a510f7b3b1a","Type":"ContainerDied","Data":"7e3ccd4e735b6ecbf5194c1078e9d67af1a51f7f867b95bcd32b6b1ae9022ecd"} Jul 22 14:16:54.677231 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.677112 2556 scope.go:117] "RemoveContainer" containerID="f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074" Jul 22 14:16:54.677231 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.677054 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp" Jul 22 14:16:54.687331 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.687312 2556 scope.go:117] "RemoveContainer" containerID="df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438" Jul 22 14:16:54.696801 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.696777 2556 scope.go:117] "RemoveContainer" containerID="f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074" Jul 22 14:16:54.697408 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:16:54.697384 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074\": container with ID starting with f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074 not found: ID does not exist" containerID="f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074" Jul 22 14:16:54.697505 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.697457 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074"} err="failed to get container status \"f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074\": rpc error: code = NotFound desc = could not find container \"f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074\": container with ID starting with f1ddc1397380d77ff77e0f2eaf11b2f8de0e949c9ad27484039f6fb4a86fc074 not found: ID does not exist" Jul 22 14:16:54.697505 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.697490 2556 scope.go:117] "RemoveContainer" containerID="df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438" Jul 22 14:16:54.697801 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:16:54.697773 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438\": container with ID starting with df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438 not found: ID does not exist" containerID="df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438" Jul 22 14:16:54.697898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.697809 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438"} err="failed to get container status \"df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438\": rpc error: code = NotFound desc = could not find container \"df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438\": container with ID starting with df59cbef3b2bfe7a0138f8bb3de0e16e3452139156d4e490ea533fcedc340438 not found: ID does not exist" Jul 22 14:16:54.699778 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.699757 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp"] Jul 22 14:16:54.703473 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:54.703445 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a098ef76-openshift-default-577ffd8f67-n7nnp"] Jul 22 14:16:55.822329 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:55.822297 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" path="/var/lib/kubelet/pods/f2881c81-ccc0-4702-a242-5a510f7b3b1a/volumes" Jul 22 14:16:57.084263 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:57.084227 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:57.348189 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:57.348148 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:57.582638 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:57.582599 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:16:57.823463 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:16:57.823374 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:23.836574 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:23.836538 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:29.793453 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:29.793413 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:29.903419 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:29.903380 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:30.005089 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:30.005054 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:45.925678 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:45.925595 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:47.407200 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:47.407162 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:51.620803 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:51.620756 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:51.694827 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:51.694788 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:51.772196 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:51.772156 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:17:51.872742 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:17:51.872640 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:02.377306 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:02.377273 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:03.242005 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:03.241972 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:10.128665 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:10.128627 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:10.232611 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:10.232577 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:10.327718 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:10.327678 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:10.431775 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:10.431688 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:11.304227 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:11.304189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:11.415451 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:11.415417 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:13.068290 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:13.068257 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:19.283571 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:19.283529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:19.380519 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:19.380480 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:19.968847 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:19.968810 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:26.730166 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:26.730127 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:27.276087 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276053 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb"] Jul 22 14:18:27.276475 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276458 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" Jul 22 14:18:27.276475 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276473 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" Jul 22 14:18:27.276475 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276482 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276488 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276501 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276507 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276571 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276579 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276585 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0211df51-e12f-40eb-a83d-d242ba2d1b0f" containerName="istio-proxy" Jul 22 14:18:27.276653 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.276591 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" Jul 22 14:18:27.280277 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.280255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.282593 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.282567 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-52896681-openshift-default-dockercfg-5rj29\"" Jul 22 14:18:27.301271 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.301239 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb"] Jul 22 14:18:27.427529 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427489 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-certs\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-istio-token\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6022790f-70a5-4e2a-9470-128081a62d26-istio-podinfo\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-socket\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-credential-socket\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-envoy\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427758 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhfr4\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-kube-api-access-rhfr4\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6022790f-70a5-4e2a-9470-128081a62d26-istiod-ca-cert\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.427898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.427859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-data\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529131 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-certs\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529131 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-istio-token\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6022790f-70a5-4e2a-9470-128081a62d26-istio-podinfo\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-socket\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-credential-socket\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-envoy\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhfr4\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-kube-api-access-rhfr4\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6022790f-70a5-4e2a-9470-128081a62d26-istiod-ca-cert\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-data\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529781 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529590 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-socket\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529781 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-certs\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529897 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529848 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-data\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.529975 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.529892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-credential-socket\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.530175 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.530148 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6022790f-70a5-4e2a-9470-128081a62d26-istiod-ca-cert\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.532083 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.532049 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-envoy\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.532414 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.532394 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6022790f-70a5-4e2a-9470-128081a62d26-istio-podinfo\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.538027 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.537999 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-istio-token\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.538169 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.538151 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhfr4\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-kube-api-access-rhfr4\") pod \"e2e-mt-52896681-openshift-default-58b966c467-7ksnb\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.591098 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.591065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:27.753011 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.752984 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb"] Jul 22 14:18:27.756336 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:18:27.756299 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6022790f_70a5_4e2a_9470_128081a62d26.slice/crio-d6f7cc507c37d61849028dcd160545ce0c751080349041e0ab465f36abcba8f9 WatchSource:0}: Error finding container d6f7cc507c37d61849028dcd160545ce0c751080349041e0ab465f36abcba8f9: Status 404 returned error can't find the container with id d6f7cc507c37d61849028dcd160545ce0c751080349041e0ab465f36abcba8f9 Jul 22 14:18:27.758698 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.758652 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:18:27.758805 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.758722 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:18:27.758805 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:27.758755 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:18:28.205072 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:28.205032 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" event={"ID":"6022790f-70a5-4e2a-9470-128081a62d26","Type":"ContainerStarted","Data":"e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915"} Jul 22 14:18:28.205298 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:28.205125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" event={"ID":"6022790f-70a5-4e2a-9470-128081a62d26","Type":"ContainerStarted","Data":"d6f7cc507c37d61849028dcd160545ce0c751080349041e0ab465f36abcba8f9"} Jul 22 14:18:28.229858 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:28.229776 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podStartSLOduration=1.229751115 podStartE2EDuration="1.229751115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:18:28.225179055 +0000 UTC m=+1934.875195118" watchObservedRunningTime="2026-07-22 14:18:28.229751115 +0000 UTC m=+1934.879767156" Jul 22 14:18:28.551586 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:28.551501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:28.592244 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:28.592212 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:28.597024 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:28.597002 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:29.210999 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:29.210964 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:29.212203 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:29.212182 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:30.177553 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:30.177521 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:30.334646 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:30.334611 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:30.426316 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:30.426286 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:30.691605 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:30.691568 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:31.140034 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:31.140002 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:31.240139 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:31.240100 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:34.686428 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:34.686383 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:35.367603 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:35.367568 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:35.466385 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:35.466352 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:35.844110 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:35.844066 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:41.861770 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:41.861722 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:41.919496 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:41.919460 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:44.212697 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.212648 2556 patch_prober.go:28] interesting pod/e2e-mt-52896681-openshift-default-58b966c467-7ksnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 22 14:18:44.213244 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.212713 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 22 14:18:44.319492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.319459 2556 generic.go:356] "Generic (PLEG): container finished" podID="6022790f-70a5-4e2a-9470-128081a62d26" containerID="e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915" exitCode=0 Jul 22 14:18:44.319672 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.319529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" event={"ID":"6022790f-70a5-4e2a-9470-128081a62d26","Type":"ContainerDied","Data":"e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915"} Jul 22 14:18:44.319967 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.319952 2556 scope.go:117] "RemoveContainer" containerID="e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915" Jul 22 14:18:44.321099 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.321067 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:18:44.321186 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.321153 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:18:44.321243 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:44.321211 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:18:45.326984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:45.326943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" event={"ID":"6022790f-70a5-4e2a-9470-128081a62d26","Type":"ContainerStarted","Data":"bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c"} Jul 22 14:18:45.591669 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:45.591638 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:45.591970 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:45.591946 2556 patch_prober.go:28] interesting pod/e2e-mt-52896681-openshift-default-58b966c467-7ksnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 22 14:18:45.592025 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:45.592004 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 22 14:18:46.592096 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:46.592053 2556 patch_prober.go:28] interesting pod/e2e-mt-52896681-openshift-default-58b966c467-7ksnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 22 14:18:46.592513 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:46.592112 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 22 14:18:47.592109 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:47.592070 2556 patch_prober.go:28] interesting pod/e2e-mt-52896681-openshift-default-58b966c467-7ksnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 22 14:18:47.592527 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:47.592132 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 22 14:18:48.591642 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:48.591601 2556 patch_prober.go:28] interesting pod/e2e-mt-52896681-openshift-default-58b966c467-7ksnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 22 14:18:48.591826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:48.591664 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 22 14:18:49.596702 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:49.596671 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:49.597142 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:49.596945 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:49.597728 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:49.597712 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:18:52.689784 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:52.689731 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:57.330392 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:57.330356 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:18:57.712847 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:18:57.712810 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:03.479794 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:03.479747 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:03.739349 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:03.739240 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb"] Jul 22 14:19:03.739539 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:03.739514 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" containerID="cri-o://bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c" gracePeriod=30 Jul 22 14:19:04.116657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:04.116613 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:04.217808 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:04.217770 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:04.350369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:04.350330 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:04.599987 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:04.599948 2556 patch_prober.go:28] interesting pod/e2e-mt-52896681-openshift-default-58b966c467-7ksnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 14:19:04.600365 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:04.600012 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 14:19:08.993363 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:08.993334 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:19:09.010104 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010016 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-istio-token\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010104 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010057 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-socket\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010104 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010100 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-data\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010379 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010145 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-credential-socket\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010379 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010193 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-certs\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010379 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010224 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-envoy\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010379 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010248 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6022790f-70a5-4e2a-9470-128081a62d26-istiod-ca-cert\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010379 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010277 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhfr4\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-kube-api-access-rhfr4\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010379 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010345 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6022790f-70a5-4e2a-9470-128081a62d26-istio-podinfo\") pod \"6022790f-70a5-4e2a-9470-128081a62d26\" (UID: \"6022790f-70a5-4e2a-9470-128081a62d26\") " Jul 22 14:19:09.010724 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010422 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:19:09.010724 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010657 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6022790f-70a5-4e2a-9470-128081a62d26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:19:09.010724 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010679 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:19:09.010899 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.010726 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.011060 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.011015 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:19:09.011207 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.011094 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-data" (OuterVolumeSpecName: "istio-data") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:19:09.012527 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.012495 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:19:09.012642 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.012559 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-kube-api-access-rhfr4" (OuterVolumeSpecName: "kube-api-access-rhfr4") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "kube-api-access-rhfr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:19:09.012642 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.012632 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-istio-token" (OuterVolumeSpecName: "istio-token") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:19:09.012750 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.012727 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6022790f-70a5-4e2a-9470-128081a62d26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6022790f-70a5-4e2a-9470-128081a62d26" (UID: "6022790f-70a5-4e2a-9470-128081a62d26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:19:09.111492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111438 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111486 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111496 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111505 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6022790f-70a5-4e2a-9470-128081a62d26-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111514 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhfr4\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-kube-api-access-rhfr4\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111523 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6022790f-70a5-4e2a-9470-128081a62d26-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111532 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6022790f-70a5-4e2a-9470-128081a62d26-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.111826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.111540 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6022790f-70a5-4e2a-9470-128081a62d26-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:19:09.456949 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.456898 2556 generic.go:356] "Generic (PLEG): container finished" podID="6022790f-70a5-4e2a-9470-128081a62d26" containerID="bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c" exitCode=0 Jul 22 14:19:09.457102 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.456969 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" Jul 22 14:19:09.457102 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.456985 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" event={"ID":"6022790f-70a5-4e2a-9470-128081a62d26","Type":"ContainerDied","Data":"bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c"} Jul 22 14:19:09.457102 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.457053 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb" event={"ID":"6022790f-70a5-4e2a-9470-128081a62d26","Type":"ContainerDied","Data":"d6f7cc507c37d61849028dcd160545ce0c751080349041e0ab465f36abcba8f9"} Jul 22 14:19:09.457102 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.457086 2556 scope.go:117] "RemoveContainer" containerID="bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c" Jul 22 14:19:09.467779 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.467761 2556 scope.go:117] "RemoveContainer" containerID="e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915" Jul 22 14:19:09.476173 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.476154 2556 scope.go:117] "RemoveContainer" containerID="bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c" Jul 22 14:19:09.476462 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:19:09.476443 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c\": container with ID starting with bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c not found: ID does not exist" containerID="bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c" Jul 22 14:19:09.476537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.476476 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c"} err="failed to get container status \"bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c\": rpc error: code = NotFound desc = could not find container \"bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c\": container with ID starting with bcb1e4fe2b256a55965537f17927e0d11d7091f8c6aa949e3685e42346e6623c not found: ID does not exist" Jul 22 14:19:09.476537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.476501 2556 scope.go:117] "RemoveContainer" containerID="e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915" Jul 22 14:19:09.476730 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:19:09.476713 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915\": container with ID starting with e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915 not found: ID does not exist" containerID="e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915" Jul 22 14:19:09.476773 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.476736 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915"} err="failed to get container status \"e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915\": rpc error: code = NotFound desc = could not find container \"e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915\": container with ID starting with e77806ce3e2d1c017517179bbb41098c518e9063964aa5c4466bf21dc4f3b915 not found: ID does not exist" Jul 22 14:19:09.481168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.481146 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb"] Jul 22 14:19:09.485680 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.485657 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-52896681-openshift-default-58b966c467-7ksnb"] Jul 22 14:19:09.821871 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:09.821783 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6022790f-70a5-4e2a-9470-128081a62d26" path="/var/lib/kubelet/pods/6022790f-70a5-4e2a-9470-128081a62d26/volumes" Jul 22 14:19:10.504686 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:10.504650 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:10.616024 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:10.615988 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:10.713319 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:10.713278 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:10.999213 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:10.999173 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:16.825613 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:16.825570 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:16.898607 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:16.898562 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:23.722638 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:23.722603 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:24.002764 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.002682 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr"] Jul 22 14:19:24.003116 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003103 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" Jul 22 14:19:24.003171 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003118 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" Jul 22 14:19:24.003171 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003136 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" Jul 22 14:19:24.003171 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003143 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71c4022-8182-43d8-9b5e-791e1ec3b1e2" containerName="istio-proxy" Jul 22 14:19:24.003171 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003158 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" Jul 22 14:19:24.003171 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003165 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" Jul 22 14:19:24.003350 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003222 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" Jul 22 14:19:24.003350 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.003232 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2881c81-ccc0-4702-a242-5a510f7b3b1a" containerName="istio-proxy" Jul 22 14:19:24.006334 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.006317 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.009670 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.009643 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-54c01305-openshift-default-dockercfg-48g47\"" Jul 22 14:19:24.025218 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.025182 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr"] Jul 22 14:19:24.048175 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048141 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istiod-ca-cert\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048350 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-podinfo\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048350 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-certs\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048350 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-data\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048525 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-token\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048525 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-socket\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048632 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-envoy\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048632 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mgsd\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-kube-api-access-6mgsd\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.048742 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.048665 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-credential-socket\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.110196 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.110146 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:24.149434 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istiod-ca-cert\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149434 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-podinfo\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149707 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-certs\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149707 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-data\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149707 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-token\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149707 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-socket\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149707 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-envoy\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.149707 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.149661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mgsd\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-kube-api-access-6mgsd\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.150065 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.150038 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-data\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.150141 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.150114 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-socket\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.150141 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.150128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-credential-socket\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.150281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.150261 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istiod-ca-cert\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.150382 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.150363 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-certs\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.150436 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.150392 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-credential-socket\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.151980 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.151959 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-envoy\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.152212 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.152196 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-podinfo\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.159629 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.159597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-token\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.164546 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.164520 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mgsd\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-kube-api-access-6mgsd\") pod \"e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.316455 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.316349 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:24.344897 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.344860 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:24.467790 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.467766 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr"] Jul 22 14:19:24.470520 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:19:24.470493 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf2b53d_1148_4b01_9c6a_9b15063a2221.slice/crio-18856695cc451d59334acc88b4dbd8a2cdedfc1e5664a165a0c5699e1ee97e30 WatchSource:0}: Error finding container 18856695cc451d59334acc88b4dbd8a2cdedfc1e5664a165a0c5699e1ee97e30: Status 404 returned error can't find the container with id 18856695cc451d59334acc88b4dbd8a2cdedfc1e5664a165a0c5699e1ee97e30 Jul 22 14:19:24.472590 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.472552 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:19:24.472698 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.472635 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:19:24.472698 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.472678 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:19:24.550159 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.550118 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" event={"ID":"3cf2b53d-1148-4b01-9c6a-9b15063a2221","Type":"ContainerStarted","Data":"c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8"} Jul 22 14:19:24.550324 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.550187 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" event={"ID":"3cf2b53d-1148-4b01-9c6a-9b15063a2221","Type":"ContainerStarted","Data":"18856695cc451d59334acc88b4dbd8a2cdedfc1e5664a165a0c5699e1ee97e30"} Jul 22 14:19:24.572340 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:24.572219 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" podStartSLOduration=1.572200321 podStartE2EDuration="1.572200321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:19:24.57011859 +0000 UTC m=+1991.220134631" watchObservedRunningTime="2026-07-22 14:19:24.572200321 +0000 UTC m=+1991.222216360" Jul 22 14:19:25.317209 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:25.317158 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:25.322212 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:25.322184 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:25.556329 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:25.556301 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:25.557471 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:25.557451 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:26.602709 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:26.602672 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:26.691397 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:26.691359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:26.759088 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:26.759049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:26.951412 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:26.951299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:27.288211 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:27.288118 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:27.388452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:27.388415 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:31.019059 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:31.019026 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:34.683585 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:34.683536 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:19:39.642225 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:39.642185 2556 generic.go:356] "Generic (PLEG): container finished" podID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerID="c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8" exitCode=0 Jul 22 14:19:39.642676 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:39.642263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" event={"ID":"3cf2b53d-1148-4b01-9c6a-9b15063a2221","Type":"ContainerDied","Data":"c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8"} Jul 22 14:19:39.642729 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:39.642711 2556 scope.go:117] "RemoveContainer" containerID="c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8" Jul 22 14:19:39.643768 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:39.643740 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:19:39.643856 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:39.643806 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:19:39.643856 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:39.643836 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:19:40.557068 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:40.557022 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:40.650437 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:40.650404 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" event={"ID":"3cf2b53d-1148-4b01-9c6a-9b15063a2221","Type":"ContainerStarted","Data":"0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c"} Jul 22 14:19:41.317477 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:41.317430 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:41.318793 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:41.318769 2556 patch_prober.go:28] interesting pod/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 22 14:19:41.318870 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:41.318831 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 22 14:19:42.316965 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:42.316891 2556 patch_prober.go:28] interesting pod/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 22 14:19:42.317369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:42.316985 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 22 14:19:43.317234 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:43.317190 2556 patch_prober.go:28] interesting pod/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 22 14:19:43.317655 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:43.317269 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 22 14:19:44.317457 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:44.317416 2556 patch_prober.go:28] interesting pod/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 22 14:19:44.317873 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:44.317476 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 22 14:19:45.321083 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:45.321049 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:45.321668 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:45.321399 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:19:45.322125 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:19:45.322106 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:20:14.969756 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:20:14.969714 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:20:19.418139 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:20:19.418101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:20:21.667645 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:20:21.667601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:20:26.748555 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:20:26.748519 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:20:40.065273 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:20:40.065238 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:20:40.167642 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:20:40.167605 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:03.014021 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:03.013989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:03.812188 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:03.812154 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:10.196276 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:10.196241 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:13.237532 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:13.237471 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:13.288179 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:13.288141 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:13.931278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:13.931251 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:21:13.946259 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:13.946229 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:21:15.941513 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:15.941479 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:16.015828 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:16.015794 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:16.255730 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:16.255647 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr"] Jul 22 14:21:16.255905 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:16.255863 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" containerID="cri-o://0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c" gracePeriod=30 Jul 22 14:21:16.277017 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:16.276981 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:16.501694 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:16.501656 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:17.603891 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:17.603858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:17.703129 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:17.703099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:17.803372 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:17.803335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:18.572884 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:18.572842 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:18.670368 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:18.670339 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:18.774637 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:18.774601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:20.206290 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:20.206251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:21.538738 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.538706 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:21:21.658730 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.658693 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-podinfo\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.658959 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.658749 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-data\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.658959 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.658774 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mgsd\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-kube-api-access-6mgsd\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.658959 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.658831 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-certs\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.658959 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.658877 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-token\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.659217 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.658975 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-socket\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.659217 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659000 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-envoy\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.659217 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659063 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istiod-ca-cert\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.659217 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659096 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-credential-socket\") pod \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\" (UID: \"3cf2b53d-1148-4b01-9c6a-9b15063a2221\") " Jul 22 14:21:21.659436 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659229 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:21:21.659436 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659246 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:21:21.659544 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659444 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:21:21.659654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659627 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:21:21.659786 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659722 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:21:21.659786 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659651 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.659921 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659817 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.659921 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.659834 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.661671 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.661644 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:21:21.661787 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.661650 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:21:21.661787 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.661701 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-kube-api-access-6mgsd" (OuterVolumeSpecName: "kube-api-access-6mgsd") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "kube-api-access-6mgsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:21:21.661787 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.661751 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cf2b53d-1148-4b01-9c6a-9b15063a2221" (UID: "3cf2b53d-1148-4b01-9c6a-9b15063a2221"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:21:21.761361 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.761325 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.761361 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.761356 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.761361 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.761365 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.761361 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.761373 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.761635 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.761381 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cf2b53d-1148-4b01-9c6a-9b15063a2221-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:21.761635 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:21.761390 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mgsd\" (UniqueName: \"kubernetes.io/projected/3cf2b53d-1148-4b01-9c6a-9b15063a2221-kube-api-access-6mgsd\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:21:22.220120 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.220079 2556 generic.go:356] "Generic (PLEG): container finished" podID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerID="0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c" exitCode=0 Jul 22 14:21:22.220301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.220136 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" Jul 22 14:21:22.220301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.220164 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" event={"ID":"3cf2b53d-1148-4b01-9c6a-9b15063a2221","Type":"ContainerDied","Data":"0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c"} Jul 22 14:21:22.220301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.220221 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr" event={"ID":"3cf2b53d-1148-4b01-9c6a-9b15063a2221","Type":"ContainerDied","Data":"18856695cc451d59334acc88b4dbd8a2cdedfc1e5664a165a0c5699e1ee97e30"} Jul 22 14:21:22.220301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.220243 2556 scope.go:117] "RemoveContainer" containerID="0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c" Jul 22 14:21:22.230315 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.230291 2556 scope.go:117] "RemoveContainer" containerID="c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8" Jul 22 14:21:22.239896 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.239872 2556 scope.go:117] "RemoveContainer" containerID="0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c" Jul 22 14:21:22.240232 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:21:22.240213 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c\": container with ID starting with 0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c not found: ID does not exist" containerID="0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c" Jul 22 14:21:22.240304 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.240244 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c"} err="failed to get container status \"0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c\": rpc error: code = NotFound desc = could not find container \"0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c\": container with ID starting with 0581c7456e0abeae8f152058f0d11737691a643d3aad7cbf43dc849d0a653d8c not found: ID does not exist" Jul 22 14:21:22.240304 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.240263 2556 scope.go:117] "RemoveContainer" containerID="c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8" Jul 22 14:21:22.240556 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:21:22.240538 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8\": container with ID starting with c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8 not found: ID does not exist" containerID="c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8" Jul 22 14:21:22.240613 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.240566 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8"} err="failed to get container status \"c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8\": rpc error: code = NotFound desc = could not find container \"c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8\": container with ID starting with c4a55bf98413e995b9715911443b80b55942e062087b80236a39b648b28264b8 not found: ID does not exist" Jul 22 14:21:22.245048 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.245024 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr"] Jul 22 14:21:22.249715 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:22.249692 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-54c01305-openshift-default-6dd6d8d8f5-jhlbr"] Jul 22 14:21:23.822600 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:23.822567 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" path="/var/lib/kubelet/pods/3cf2b53d-1148-4b01-9c6a-9b15063a2221/volumes" Jul 22 14:21:24.208799 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:24.208760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:25.964201 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:25.964170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:26.029449 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:26.029416 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:26.642799 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:26.642758 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:27.317361 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:27.317319 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:27.424138 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:27.424102 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:33.532359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:33.532313 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:33.723897 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:33.723858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:44.116320 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:44.116283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:44.471145 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:44.471057 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:21:45.505356 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:21:45.505325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:05.486250 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:05.486165 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:11.646341 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:11.646308 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:11.747241 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:11.747211 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:12.019427 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.019345 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:12.300559 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300486 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22"] Jul 22 14:22:12.300852 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300840 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" Jul 22 14:22:12.300904 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300854 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" Jul 22 14:22:12.300904 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300877 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" Jul 22 14:22:12.300904 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300883 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" Jul 22 14:22:12.301054 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300977 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" Jul 22 14:22:12.301054 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300985 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6022790f-70a5-4e2a-9470-128081a62d26" containerName="istio-proxy" Jul 22 14:22:12.301054 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.300995 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" Jul 22 14:22:12.304072 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.304053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.306776 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.306755 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-53a937-openshift-default-dockercfg-rr9tf\"" Jul 22 14:22:12.318340 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.318312 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22"] Jul 22 14:22:12.335750 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.335710 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:12.405485 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-socket\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405648 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-envoy\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405648 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-credential-socket\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405648 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-token\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405648 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istiod-ca-cert\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405865 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-podinfo\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405865 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzjr\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-kube-api-access-wrzjr\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405865 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-certs\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.405865 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.405743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-data\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507010 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.506975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istiod-ca-cert\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507193 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-podinfo\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507193 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzjr\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-kube-api-access-wrzjr\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507193 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-certs\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507193 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-data\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507193 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-socket\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507474 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-envoy\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507474 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-credential-socket\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507585 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-certs\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507585 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-token\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507691 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507583 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-data\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507691 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507606 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-socket\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507806 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507785 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-credential-socket\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.507843 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.507791 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istiod-ca-cert\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.509481 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.509458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-envoy\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.509598 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.509565 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-podinfo\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.515181 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.515160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-token\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.515283 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.515231 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzjr\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-kube-api-access-wrzjr\") pod \"e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.614202 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.614169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:12.749898 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.749867 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22"] Jul 22 14:22:12.751271 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:22:12.751247 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4770ca90_2f7b_41a7_a348_00156c5ec7e1.slice/crio-b16cab382ff457461387d0f55c48c689aa2a3fa9ade20828263d4484bbf387f7 WatchSource:0}: Error finding container b16cab382ff457461387d0f55c48c689aa2a3fa9ade20828263d4484bbf387f7: Status 404 returned error can't find the container with id b16cab382ff457461387d0f55c48c689aa2a3fa9ade20828263d4484bbf387f7 Jul 22 14:22:12.753796 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.753763 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:12.753882 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.753832 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:12.753882 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:12.753866 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:13.025312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:13.025237 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:13.507855 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:13.507818 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" event={"ID":"4770ca90-2f7b-41a7-a348-00156c5ec7e1","Type":"ContainerStarted","Data":"c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588"} Jul 22 14:22:13.508095 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:13.507875 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" event={"ID":"4770ca90-2f7b-41a7-a348-00156c5ec7e1","Type":"ContainerStarted","Data":"b16cab382ff457461387d0f55c48c689aa2a3fa9ade20828263d4484bbf387f7"} Jul 22 14:22:13.551886 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:13.551836 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podStartSLOduration=1.551821305 podStartE2EDuration="1.551821305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:22:13.547304286 +0000 UTC m=+2160.197320326" watchObservedRunningTime="2026-07-22 14:22:13.551821305 +0000 UTC m=+2160.201837404" Jul 22 14:22:13.614322 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:13.614293 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:13.619044 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:13.619021 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:14.513452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:14.513423 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:14.514380 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:14.514359 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:15.503541 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:15.503503 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:15.587212 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:15.587179 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:15.659060 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:15.659024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:15.798345 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:15.798263 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:16.185331 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:16.185291 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:16.275302 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:16.275269 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:20.024548 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.024510 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:20.363896 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.363864 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:20.660773 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.660698 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth"] Jul 22 14:22:20.661097 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.661084 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" Jul 22 14:22:20.661152 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.661099 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf2b53d-1148-4b01-9c6a-9b15063a2221" containerName="istio-proxy" Jul 22 14:22:20.664307 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.664291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.666358 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.666336 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-13629f-openshift-default-dockercfg-plxfp\"" Jul 22 14:22:20.677120 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.677101 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth"] Jul 22 14:22:20.682527 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.682498 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:20.685744 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/277ca8df-e618-4365-93df-908ad05c3d34-istio-podinfo\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.685846 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685754 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-certs\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.685846 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-envoy\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.685846 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2bqw\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-kube-api-access-m2bqw\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.685984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-socket\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.685984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/277ca8df-e618-4365-93df-908ad05c3d34-istiod-ca-cert\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.685984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.685980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-istio-token\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.686097 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.686003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-data\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.686097 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.686067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-credential-socket\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.786620 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-envoy\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.786835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786638 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2bqw\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-kube-api-access-m2bqw\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.786835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-socket\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.786835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/277ca8df-e618-4365-93df-908ad05c3d34-istiod-ca-cert\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.786835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-istio-token\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.786835 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-data\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787149 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-credential-socket\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787149 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.786994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/277ca8df-e618-4365-93df-908ad05c3d34-istio-podinfo\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787256 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.787160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-socket\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787256 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.787195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-certs\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787372 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.787256 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-credential-socket\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787372 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.787279 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-data\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787471 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.787443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-certs\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.787510 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.787493 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/277ca8df-e618-4365-93df-908ad05c3d34-istiod-ca-cert\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.789010 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.788989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-envoy\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.789411 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.789390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/277ca8df-e618-4365-93df-908ad05c3d34-istio-podinfo\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.794336 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.794312 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-istio-token\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.794426 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.794397 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2bqw\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-kube-api-access-m2bqw\") pod \"e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:20.930922 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.930806 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:20.974865 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:20.974840 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:21.113164 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.113134 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth"] Jul 22 14:22:21.114690 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:22:21.114662 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277ca8df_e618_4365_93df_908ad05c3d34.slice/crio-433ab7cfbe014c09ada58e62e04eb8b69b5468f93730d17429b75908193388b9 WatchSource:0}: Error finding container 433ab7cfbe014c09ada58e62e04eb8b69b5468f93730d17429b75908193388b9: Status 404 returned error can't find the container with id 433ab7cfbe014c09ada58e62e04eb8b69b5468f93730d17429b75908193388b9 Jul 22 14:22:21.116838 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.116806 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:21.116982 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.116873 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:21.116982 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.116901 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:21.551652 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.551619 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" event={"ID":"277ca8df-e618-4365-93df-908ad05c3d34","Type":"ContainerStarted","Data":"f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd"} Jul 22 14:22:21.551832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.551705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" event={"ID":"277ca8df-e618-4365-93df-908ad05c3d34","Type":"ContainerStarted","Data":"433ab7cfbe014c09ada58e62e04eb8b69b5468f93730d17429b75908193388b9"} Jul 22 14:22:21.574807 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.574757 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podStartSLOduration=1.5747422800000002 podStartE2EDuration="1.57474228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:22:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:22:21.574061463 +0000 UTC m=+2168.224077502" watchObservedRunningTime="2026-07-22 14:22:21.57474228 +0000 UTC m=+2168.224758388" Jul 22 14:22:21.975261 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:21.975232 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:22.984817 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:22.984782 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:23.544534 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:23.544501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:23.587745 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:23.585305 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:23.589157 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:23.588951 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:23.630006 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:23.629891 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:23.808117 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:23.808032 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:24.372893 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:24.372857 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:24.485051 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:24.485015 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:24.576505 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:24.576422 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:28.066754 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:28.066719 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:29.515053 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.514949 2556 patch_prober.go:28] interesting pod/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 22 14:22:29.515053 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.515010 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 22 14:22:29.621985 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.621952 2556 generic.go:356] "Generic (PLEG): container finished" podID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerID="c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588" exitCode=0 Jul 22 14:22:29.622153 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.622025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" event={"ID":"4770ca90-2f7b-41a7-a348-00156c5ec7e1","Type":"ContainerDied","Data":"c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588"} Jul 22 14:22:29.622402 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.622389 2556 scope.go:117] "RemoveContainer" containerID="c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588" Jul 22 14:22:29.623429 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.623399 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:29.623532 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.623478 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:29.623597 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:29.623547 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:30.628902 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:30.628864 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" event={"ID":"4770ca90-2f7b-41a7-a348-00156c5ec7e1","Type":"ContainerStarted","Data":"25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b"} Jul 22 14:22:31.614776 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:31.614739 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:31.615007 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:31.614846 2556 patch_prober.go:28] interesting pod/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 22 14:22:31.615007 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:31.614880 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 22 14:22:32.615412 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:32.615372 2556 patch_prober.go:28] interesting pod/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 22 14:22:32.615811 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:32.615433 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 22 14:22:33.615240 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:33.615201 2556 patch_prober.go:28] interesting pod/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 22 14:22:33.615415 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:33.615261 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 22 14:22:34.614802 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:34.614766 2556 patch_prober.go:28] interesting pod/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 22 14:22:34.615224 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:34.614821 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 22 14:22:35.619245 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.619216 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:35.619685 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.619491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:35.620204 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.620182 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:22:35.658594 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.658465 2556 generic.go:356] "Generic (PLEG): container finished" podID="277ca8df-e618-4365-93df-908ad05c3d34" containerID="f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd" exitCode=0 Jul 22 14:22:35.658594 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.658541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" event={"ID":"277ca8df-e618-4365-93df-908ad05c3d34","Type":"ContainerDied","Data":"f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd"} Jul 22 14:22:35.659052 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.659030 2556 scope.go:117] "RemoveContainer" containerID="f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd" Jul 22 14:22:35.660132 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.660100 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:35.660220 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.660177 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:35.660283 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:35.660248 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:22:36.666228 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:36.666197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" event={"ID":"277ca8df-e618-4365-93df-908ad05c3d34","Type":"ContainerStarted","Data":"18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a"} Jul 22 14:22:36.976576 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:36.975204 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:36.977291 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:36.976951 2556 patch_prober.go:28] interesting pod/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 22 14:22:36.977291 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:36.977007 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 22 14:22:36.984802 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:36.984771 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:37.084474 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:37.084434 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:37.976197 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:37.976152 2556 patch_prober.go:28] interesting pod/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 22 14:22:37.976691 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:37.976217 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 22 14:22:38.584716 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:38.584684 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:38.975994 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:38.975956 2556 patch_prober.go:28] interesting pod/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 22 14:22:38.976318 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:38.976291 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 22 14:22:39.976293 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:39.975817 2556 patch_prober.go:28] interesting pod/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 22 14:22:39.976293 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:39.975884 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 22 14:22:40.975789 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:40.975745 2556 patch_prober.go:28] interesting pod/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 22 14:22:40.975984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:40.975815 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 22 14:22:41.978891 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:41.978863 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:41.979793 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:41.979775 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:22:45.179454 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:45.179412 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:45.282386 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:45.282355 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:22:50.262271 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:22:50.262234 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:23:31.284971 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:23:31.284937 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:23:58.391752 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:23:58.391717 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:23.811111 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:23.811083 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:24.785363 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:24.785328 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:25.435205 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:25.435167 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:25.535677 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:25.535645 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:35.333085 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:35.333036 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:39.934249 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:39.934209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:40.375662 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:40.375631 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:46.407385 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:46.407350 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:46.471057 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:46.471034 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:46.668285 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:46.668208 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22"] Jul 22 14:24:46.668464 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:46.668421 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" containerID="cri-o://25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b" gracePeriod=30 Jul 22 14:24:46.692857 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:46.692823 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:46.920107 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:46.920016 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:47.712081 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:47.712049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:47.808956 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:47.808926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:24:50.621702 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:50.621667 2556 patch_prober.go:28] interesting pod/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 14:24:50.622105 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:50.621721 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 14:24:51.924028 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.924000 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:24:51.994290 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994212 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-credential-socket\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994290 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994271 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-certs\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994290 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994291 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-data\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994316 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-token\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994346 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-podinfo\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994385 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrzjr\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-kube-api-access-wrzjr\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994420 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-socket\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994470 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-envoy\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994516 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istiod-ca-cert\") pod \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\" (UID: \"4770ca90-2f7b-41a7-a348-00156c5ec7e1\") " Jul 22 14:24:51.994578 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994518 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:24:51.994930 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994621 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:24:51.994930 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994775 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:24:51.994930 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994869 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:51.994930 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994888 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:51.994930 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994902 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:51.995142 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.994926 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:24:51.995246 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.995220 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:24:51.996740 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.996709 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:24:51.996851 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.996757 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-kube-api-access-wrzjr" (OuterVolumeSpecName: "kube-api-access-wrzjr") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "kube-api-access-wrzjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:24:51.997028 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.997005 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:24:51.997090 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:51.997031 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "4770ca90-2f7b-41a7-a348-00156c5ec7e1" (UID: "4770ca90-2f7b-41a7-a348-00156c5ec7e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:24:52.095602 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.095569 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:52.095602 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.095598 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:52.095602 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.095606 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:52.095602 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.095613 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:52.095862 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.095622 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4770ca90-2f7b-41a7-a348-00156c5ec7e1-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:52.095862 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.095630 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrzjr\" (UniqueName: \"kubernetes.io/projected/4770ca90-2f7b-41a7-a348-00156c5ec7e1-kube-api-access-wrzjr\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:24:52.426200 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.426164 2556 generic.go:356] "Generic (PLEG): container finished" podID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerID="25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b" exitCode=0 Jul 22 14:24:52.426378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.426217 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" Jul 22 14:24:52.426378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.426245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" event={"ID":"4770ca90-2f7b-41a7-a348-00156c5ec7e1","Type":"ContainerDied","Data":"25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b"} Jul 22 14:24:52.426378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.426312 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22" event={"ID":"4770ca90-2f7b-41a7-a348-00156c5ec7e1","Type":"ContainerDied","Data":"b16cab382ff457461387d0f55c48c689aa2a3fa9ade20828263d4484bbf387f7"} Jul 22 14:24:52.426378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.426341 2556 scope.go:117] "RemoveContainer" containerID="25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b" Jul 22 14:24:52.436160 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.436146 2556 scope.go:117] "RemoveContainer" containerID="c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588" Jul 22 14:24:52.444198 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.444182 2556 scope.go:117] "RemoveContainer" containerID="25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b" Jul 22 14:24:52.444448 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:24:52.444431 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b\": container with ID starting with 25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b not found: ID does not exist" containerID="25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b" Jul 22 14:24:52.444495 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.444456 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b"} err="failed to get container status \"25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b\": rpc error: code = NotFound desc = could not find container \"25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b\": container with ID starting with 25d8dddfebb519bacf053b23366f3872179312089ac83d4eaec04000f245280b not found: ID does not exist" Jul 22 14:24:52.444495 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.444473 2556 scope.go:117] "RemoveContainer" containerID="c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588" Jul 22 14:24:52.444697 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:24:52.444680 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588\": container with ID starting with c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588 not found: ID does not exist" containerID="c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588" Jul 22 14:24:52.444740 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.444701 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588"} err="failed to get container status \"c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588\": rpc error: code = NotFound desc = could not find container \"c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588\": container with ID starting with c430508d2eaeafaf950ba14c8f2e134ac542f5f7ca775778ff0e1df229114588 not found: ID does not exist" Jul 22 14:24:52.448422 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.448401 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22"] Jul 22 14:24:52.452097 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:52.452076 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-53a937-openshift-default-6cb85589b5-6bv22"] Jul 22 14:24:53.822567 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:53.822537 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" path="/var/lib/kubelet/pods/4770ca90-2f7b-41a7-a348-00156c5ec7e1/volumes" Jul 22 14:24:57.492726 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:24:57.492692 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:02.134554 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:02.134519 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:02.683577 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:02.683538 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:08.574298 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:08.574211 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:08.632897 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:08.632868 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:08.890269 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:08.890237 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth"] Jul 22 14:25:08.890505 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:08.890481 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" containerID="cri-o://18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a" gracePeriod=30 Jul 22 14:25:08.912280 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:08.912251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:09.182346 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.182263 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:09.562378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.562286 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:09.870666 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.870638 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt"] Jul 22 14:25:09.871079 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.871063 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" Jul 22 14:25:09.871123 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.871081 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" Jul 22 14:25:09.871123 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.871092 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" Jul 22 14:25:09.871123 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.871097 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" Jul 22 14:25:09.871218 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.871167 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" Jul 22 14:25:09.875490 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.875474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.878654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.878636 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c0776d-openshift-default-dockercfg-vn6lz\"" Jul 22 14:25:09.888624 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.888602 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt"] Jul 22 14:25:09.906011 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.905986 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:09.965551 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-certs\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-socket\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-token\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965723 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istiod-ca-cert\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965926 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-podinfo\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965926 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-envoy\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965926 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-credential-socket\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965926 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd74l\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-kube-api-access-gd74l\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:09.965926 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:09.965833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-data\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.065523 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.065492 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:10.066476 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.066452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-podinfo\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.066608 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.066500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-envoy\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.066675 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.066660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-credential-socket\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.066732 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.066708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd74l\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-kube-api-access-gd74l\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.066806 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.066773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-data\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.066875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-certs\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.067626 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-credential-socket\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.067666 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-data\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.067681 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-certs\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.067696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-socket\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.067748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-token\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.067795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istiod-ca-cert\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.068137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-socket\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.068927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istiod-ca-cert\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069868 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.069597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-envoy\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.069868 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.069797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-podinfo\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.075243 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.075220 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd74l\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-kube-api-access-gd74l\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.077566 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.077544 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-token\") pod \"e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.186346 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.186277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:10.323798 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.323732 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt"] Jul 22 14:25:10.326263 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:25:10.326236 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cf1ec1_c44c_47a6_8ffa_3d0c9ef5db4e.slice/crio-01e030ca67cb5619384b8eb1ee6b34fbcd5dd5fbf3fb2a15ddd89e1dd068e381 WatchSource:0}: Error finding container 01e030ca67cb5619384b8eb1ee6b34fbcd5dd5fbf3fb2a15ddd89e1dd068e381: Status 404 returned error can't find the container with id 01e030ca67cb5619384b8eb1ee6b34fbcd5dd5fbf3fb2a15ddd89e1dd068e381 Jul 22 14:25:10.328764 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.328729 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:10.328832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.328800 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:10.328871 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.328831 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:10.528063 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.527977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" event={"ID":"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e","Type":"ContainerStarted","Data":"a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c"} Jul 22 14:25:10.528063 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.528034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" event={"ID":"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e","Type":"ContainerStarted","Data":"01e030ca67cb5619384b8eb1ee6b34fbcd5dd5fbf3fb2a15ddd89e1dd068e381"} Jul 22 14:25:10.551836 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:10.551784 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podStartSLOduration=1.551763883 podStartE2EDuration="1.551763883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:25:10.549392867 +0000 UTC m=+2337.199408906" watchObservedRunningTime="2026-07-22 14:25:10.551763883 +0000 UTC m=+2337.201779923" Jul 22 14:25:11.187267 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:11.187232 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:11.191953 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:11.191901 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:11.533583 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:11.533501 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:11.534410 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:11.534393 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:11.981251 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:11.981198 2556 patch_prober.go:28] interesting pod/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 14:25:11.981450 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:11.981271 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 14:25:12.538224 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:12.538187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:12.639161 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:12.639133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:12.794210 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:12.794134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:12.871753 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:12.871719 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:13.415349 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:13.415315 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:13.516455 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:13.516423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:14.149191 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.149126 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:25:14.205744 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205711 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-credential-socket\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.205934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205757 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/277ca8df-e618-4365-93df-908ad05c3d34-istio-podinfo\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.205934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205782 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2bqw\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-kube-api-access-m2bqw\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.205934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205817 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-socket\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.205934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205841 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-istio-token\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.205934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205885 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-envoy\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.206209 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.205978 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:25:14.206209 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206039 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-data\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.206209 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206125 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:25:14.206209 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206160 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/277ca8df-e618-4365-93df-908ad05c3d34-istiod-ca-cert\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.206209 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206197 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-certs\") pod \"277ca8df-e618-4365-93df-908ad05c3d34\" (UID: \"277ca8df-e618-4365-93df-908ad05c3d34\") " Jul 22 14:25:14.206525 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206498 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277ca8df-e618-4365-93df-908ad05c3d34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:25:14.206587 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206544 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.206587 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.206563 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.207090 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.207064 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:25:14.207518 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.207482 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-data" (OuterVolumeSpecName: "istio-data") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:25:14.208254 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.208231 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-kube-api-access-m2bqw" (OuterVolumeSpecName: "kube-api-access-m2bqw") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "kube-api-access-m2bqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:25:14.208351 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.208332 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-istio-token" (OuterVolumeSpecName: "istio-token") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:25:14.208406 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.208388 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:25:14.208839 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.208820 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/277ca8df-e618-4365-93df-908ad05c3d34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "277ca8df-e618-4365-93df-908ad05c3d34" (UID: "277ca8df-e618-4365-93df-908ad05c3d34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:25:14.307504 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307473 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.307504 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307501 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.307657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307513 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/277ca8df-e618-4365-93df-908ad05c3d34-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.307657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307525 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/277ca8df-e618-4365-93df-908ad05c3d34-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.307657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307535 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/277ca8df-e618-4365-93df-908ad05c3d34-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.307657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307546 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2bqw\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-kube-api-access-m2bqw\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.307657 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.307560 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/277ca8df-e618-4365-93df-908ad05c3d34-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:25:14.550878 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.550790 2556 generic.go:356] "Generic (PLEG): container finished" podID="277ca8df-e618-4365-93df-908ad05c3d34" containerID="18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a" exitCode=0 Jul 22 14:25:14.550878 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.550848 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" Jul 22 14:25:14.551083 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.550850 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" event={"ID":"277ca8df-e618-4365-93df-908ad05c3d34","Type":"ContainerDied","Data":"18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a"} Jul 22 14:25:14.551083 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.550995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth" event={"ID":"277ca8df-e618-4365-93df-908ad05c3d34","Type":"ContainerDied","Data":"433ab7cfbe014c09ada58e62e04eb8b69b5468f93730d17429b75908193388b9"} Jul 22 14:25:14.551083 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.551025 2556 scope.go:117] "RemoveContainer" containerID="18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a" Jul 22 14:25:14.560310 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.560295 2556 scope.go:117] "RemoveContainer" containerID="f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd" Jul 22 14:25:14.568176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.568160 2556 scope.go:117] "RemoveContainer" containerID="18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a" Jul 22 14:25:14.568405 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:25:14.568388 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a\": container with ID starting with 18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a not found: ID does not exist" containerID="18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a" Jul 22 14:25:14.568446 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.568413 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a"} err="failed to get container status \"18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a\": rpc error: code = NotFound desc = could not find container \"18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a\": container with ID starting with 18899485a29387efa69b6f75c7164341f65423d0a3fb7586b4c6d33d21f7a62a not found: ID does not exist" Jul 22 14:25:14.568446 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.568429 2556 scope.go:117] "RemoveContainer" containerID="f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd" Jul 22 14:25:14.568621 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:25:14.568605 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd\": container with ID starting with f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd not found: ID does not exist" containerID="f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd" Jul 22 14:25:14.568664 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.568625 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd"} err="failed to get container status \"f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd\": rpc error: code = NotFound desc = could not find container \"f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd\": container with ID starting with f6de78c96476f96153bd555362ec02cdffa8ac5e9b6c5b75e3bb7d6e1a38b4fd not found: ID does not exist" Jul 22 14:25:14.573540 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.573522 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth"] Jul 22 14:25:14.580826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:14.580804 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-13629f-openshift-default-7f68f84cd5-xhpth"] Jul 22 14:25:15.822175 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:15.822145 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="277ca8df-e618-4365-93df-908ad05c3d34" path="/var/lib/kubelet/pods/277ca8df-e618-4365-93df-908ad05c3d34/volumes" Jul 22 14:25:17.065010 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.064980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:17.859918 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.859879 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5"] Jul 22 14:25:17.860276 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860263 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" Jul 22 14:25:17.860319 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860278 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" Jul 22 14:25:17.860319 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860287 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" Jul 22 14:25:17.860319 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860294 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" Jul 22 14:25:17.860411 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860359 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" Jul 22 14:25:17.860411 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860368 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4770ca90-2f7b-41a7-a348-00156c5ec7e1" containerName="istio-proxy" Jul 22 14:25:17.860411 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.860374 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="277ca8df-e618-4365-93df-908ad05c3d34" containerName="istio-proxy" Jul 22 14:25:17.864811 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.864790 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.866763 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.866741 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dba614-openshift-default-dockercfg-k5tkh\"" Jul 22 14:25:17.876267 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.876243 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5"] Jul 22 14:25:17.936341 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-socket\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936341 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-certs\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg8g5\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-kube-api-access-tg8g5\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-credential-socket\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-podinfo\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-envoy\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86422ec0-cfec-4a65-93c1-29bed1d08e73-istiod-ca-cert\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936710 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-data\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:17.936710 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:17.936580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-token\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.037728 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.037697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg8g5\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-kube-api-access-tg8g5\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.037894 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.037754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-credential-socket\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.037894 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.037778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-podinfo\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.037894 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.037804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-envoy\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.037894 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.037821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86422ec0-cfec-4a65-93c1-29bed1d08e73-istiod-ca-cert\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038041 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-data\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-token\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038227 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-socket\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038227 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-certs\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038227 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038214 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-credential-socket\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038378 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038334 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-data\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038601 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-socket\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038601 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-certs\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.038731 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.038594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86422ec0-cfec-4a65-93c1-29bed1d08e73-istiod-ca-cert\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.040630 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.040607 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-envoy\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.040808 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.040790 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-podinfo\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.046079 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.046056 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-token\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.046314 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.046294 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg8g5\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-kube-api-access-tg8g5\") pod \"e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.176408 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.176324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:18.273875 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.273842 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:18.314873 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.314845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5"] Jul 22 14:25:18.315584 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:25:18.315560 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86422ec0_cfec_4a65_93c1_29bed1d08e73.slice/crio-109b9492cd10cbbbd713fa97ba53347149a599accda7ff90181fbe884c7e7344 WatchSource:0}: Error finding container 109b9492cd10cbbbd713fa97ba53347149a599accda7ff90181fbe884c7e7344: Status 404 returned error can't find the container with id 109b9492cd10cbbbd713fa97ba53347149a599accda7ff90181fbe884c7e7344 Jul 22 14:25:18.318238 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.318203 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:18.318331 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.318285 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:18.318389 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.318335 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:18.373500 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.373475 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:18.577872 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.577780 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" event={"ID":"86422ec0-cfec-4a65-93c1-29bed1d08e73","Type":"ContainerStarted","Data":"51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17"} Jul 22 14:25:18.577872 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.577830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" event={"ID":"86422ec0-cfec-4a65-93c1-29bed1d08e73","Type":"ContainerStarted","Data":"109b9492cd10cbbbd713fa97ba53347149a599accda7ff90181fbe884c7e7344"} Jul 22 14:25:18.599503 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:18.599445 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podStartSLOduration=1.599429872 podStartE2EDuration="1.599429872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:25:18.597108675 +0000 UTC m=+2345.247124718" watchObservedRunningTime="2026-07-22 14:25:18.599429872 +0000 UTC m=+2345.249445910" Jul 22 14:25:19.176617 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:19.176579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:19.181849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:19.181826 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:19.583929 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:19.583834 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:19.584745 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:19.584725 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:20.550272 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:20.550238 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:20.626347 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:20.626316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:20.715311 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:20.715274 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:21.018586 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:21.018549 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:21.223648 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:21.223604 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:21.325528 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:21.325435 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:25.889700 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:25.889653 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:27.140201 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.138452 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:51332->10.132.0.66:15021: read: connection reset by peer" start-of-body= Jul 22 14:25:27.140201 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.138515 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:51332->10.132.0.66:15021: read: connection reset by peer" Jul 22 14:25:27.626953 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.626898 2556 generic.go:356] "Generic (PLEG): container finished" podID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerID="a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c" exitCode=0 Jul 22 14:25:27.627141 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.626973 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" event={"ID":"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e","Type":"ContainerDied","Data":"a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c"} Jul 22 14:25:27.627399 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.627386 2556 scope.go:117] "RemoveContainer" containerID="a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c" Jul 22 14:25:27.628420 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.628394 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:27.628472 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.628460 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:27.628510 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:27.628491 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:28.633991 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:28.633958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" event={"ID":"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e","Type":"ContainerStarted","Data":"c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb"} Jul 22 14:25:29.186882 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:29.186847 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:29.187060 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:29.187007 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 22 14:25:29.187103 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:29.187050 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 22 14:25:30.186851 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:30.186805 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 22 14:25:30.187383 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:30.186874 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 22 14:25:31.187057 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:31.187020 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 22 14:25:31.187443 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:31.187076 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 22 14:25:32.186818 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:32.186784 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 22 14:25:32.187048 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:32.186839 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 22 14:25:33.187475 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:33.187432 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 22 14:25:33.187942 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:33.187491 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 22 14:25:33.721494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:33.721458 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:34.190590 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.190561 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:34.191043 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.190829 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:34.191448 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.191430 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:25:34.586156 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.586076 2556 patch_prober.go:28] interesting pod/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 22 14:25:34.586156 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.586127 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 22 14:25:34.673081 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.673051 2556 generic.go:356] "Generic (PLEG): container finished" podID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerID="51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17" exitCode=0 Jul 22 14:25:34.673265 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.673125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" event={"ID":"86422ec0-cfec-4a65-93c1-29bed1d08e73","Type":"ContainerDied","Data":"51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17"} Jul 22 14:25:34.673646 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.673631 2556 scope.go:117] "RemoveContainer" containerID="51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17" Jul 22 14:25:34.674706 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.674678 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:34.674776 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.674759 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:34.674822 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.674807 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:25:34.781009 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:34.780982 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:35.680950 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:35.680890 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" event={"ID":"86422ec0-cfec-4a65-93c1-29bed1d08e73","Type":"ContainerStarted","Data":"b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf"} Jul 22 14:25:36.177377 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:36.177338 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:36.177606 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:36.177584 2556 patch_prober.go:28] interesting pod/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 22 14:25:36.177660 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:36.177632 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 22 14:25:37.177380 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:37.177338 2556 patch_prober.go:28] interesting pod/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 22 14:25:37.178389 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:37.177977 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 22 14:25:38.177293 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:38.177248 2556 patch_prober.go:28] interesting pod/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 22 14:25:38.177511 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:38.177316 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 22 14:25:39.177529 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:39.177490 2556 patch_prober.go:28] interesting pod/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 22 14:25:39.178137 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:39.178104 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 22 14:25:40.177390 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:40.177347 2556 patch_prober.go:28] interesting pod/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 22 14:25:40.177688 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:40.177652 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 22 14:25:41.180447 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:41.180415 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:41.180831 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:41.180767 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:41.181489 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:41.181469 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:25:42.037416 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:42.037384 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:42.138722 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:42.138689 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:43.712056 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:43.712017 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:43.813885 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:43.813853 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:49.001491 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:49.001454 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:53.236412 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:53.236376 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:53.623042 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:53.623012 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:59.654159 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:59.654121 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:59.752412 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:59.752373 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:25:59.910733 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:59.910653 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt"] Jul 22 14:25:59.910934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:25:59.910871 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" containerID="cri-o://c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb" gracePeriod=30 Jul 22 14:26:01.684170 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:01.684125 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:01.785239 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:01.785202 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:04.193629 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:04.193592 2556 patch_prober.go:28] interesting pod/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 14:26:04.194026 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:04.193659 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 14:26:05.167804 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.167782 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:26:05.286769 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.286687 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istiod-ca-cert\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.286769 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.286739 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-certs\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.286777 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-envoy\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.286796 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-token\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.286838 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd74l\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-kube-api-access-gd74l\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.286867 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-credential-socket\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287008 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-socket\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287041 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-podinfo\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287066 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-data\") pod \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\" (UID: \"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e\") " Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287129 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287180 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:05.287337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287237 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:26:05.287849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287422 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.287849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287442 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.287849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287456 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.287849 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.287530 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:05.288346 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.288320 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:05.289113 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.289080 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:05.289225 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.289141 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:26:05.289225 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.289185 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-kube-api-access-gd74l" (OuterVolumeSpecName: "kube-api-access-gd74l") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "kube-api-access-gd74l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:26:05.289337 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.289297 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" (UID: "d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:26:05.388884 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.388857 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.388884 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.388881 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.389051 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.388894 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd74l\" (UniqueName: \"kubernetes.io/projected/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-kube-api-access-gd74l\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.389051 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.388931 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.389051 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.388947 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.389051 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.388958 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:05.854536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.854508 2556 generic.go:356] "Generic (PLEG): container finished" podID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerID="c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb" exitCode=0 Jul 22 14:26:05.854685 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.854557 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" Jul 22 14:26:05.854685 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.854591 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" event={"ID":"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e","Type":"ContainerDied","Data":"c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb"} Jul 22 14:26:05.854685 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.854644 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt" event={"ID":"d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e","Type":"ContainerDied","Data":"01e030ca67cb5619384b8eb1ee6b34fbcd5dd5fbf3fb2a15ddd89e1dd068e381"} Jul 22 14:26:05.854685 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.854673 2556 scope.go:117] "RemoveContainer" containerID="c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb" Jul 22 14:26:05.863717 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.863702 2556 scope.go:117] "RemoveContainer" containerID="a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c" Jul 22 14:26:05.871886 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.871868 2556 scope.go:117] "RemoveContainer" containerID="c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb" Jul 22 14:26:05.872183 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:26:05.872160 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb\": container with ID starting with c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb not found: ID does not exist" containerID="c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb" Jul 22 14:26:05.872278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.872188 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb"} err="failed to get container status \"c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb\": rpc error: code = NotFound desc = could not find container \"c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb\": container with ID starting with c459e60a61f2b64d6d72f52454181d0d4b80980ea3b5994277436198d5eb86eb not found: ID does not exist" Jul 22 14:26:05.872278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.872206 2556 scope.go:117] "RemoveContainer" containerID="a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c" Jul 22 14:26:05.872427 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:26:05.872412 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c\": container with ID starting with a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c not found: ID does not exist" containerID="a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c" Jul 22 14:26:05.872464 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.872431 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c"} err="failed to get container status \"a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c\": rpc error: code = NotFound desc = could not find container \"a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c\": container with ID starting with a28c834c35a653f8251c6656c2eca5b0cdfc5e10a1fa9cae33d5291e536b5d5c not found: ID does not exist" Jul 22 14:26:05.874532 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.874512 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt"] Jul 22 14:26:05.876677 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:05.876659 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c0776d-openshift-default-55bd7f44d9-9g4vt"] Jul 22 14:26:07.821738 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:07.821705 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" path="/var/lib/kubelet/pods/d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e/volumes" Jul 22 14:26:13.978612 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:13.978580 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:26:13.986257 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:13.986235 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:26:15.909367 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:15.909338 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:20.371460 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:20.371421 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:20.778597 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:20.778524 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:27.235853 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:27.235816 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:27.534083 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:27.533997 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5"] Jul 22 14:26:27.534246 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:27.534208 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" containerID="cri-o://b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf" gracePeriod=30 Jul 22 14:26:28.520182 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520150 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm"] Jul 22 14:26:28.520561 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520527 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" Jul 22 14:26:28.520561 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520537 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" Jul 22 14:26:28.520561 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520550 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" Jul 22 14:26:28.520561 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520555 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" Jul 22 14:26:28.520700 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520627 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" Jul 22 14:26:28.520700 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.520635 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cf1ec1-c44c-47a6-8ffa-3d0c9ef5db4e" containerName="istio-proxy" Jul 22 14:26:28.523199 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.523182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.525434 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.525412 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7d1f11-openshift-default-dockercfg-cckvw\"" Jul 22 14:26:28.547451 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.547426 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm"] Jul 22 14:26:28.691121 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/232fb082-0530-45cf-a429-ce3cc0a6ea12-istiod-ca-cert\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691344 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-envoy\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691344 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-credential-socket\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691344 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-certs\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691595 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5265h\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-kube-api-access-5265h\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691595 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-podinfo\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691595 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-data\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691595 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-socket\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.691595 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.691522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-token\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792207 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-envoy\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792312 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-credential-socket\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-certs\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5265h\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-kube-api-access-5265h\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-podinfo\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-data\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-socket\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-token\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/232fb082-0530-45cf-a429-ce3cc0a6ea12-istiod-ca-cert\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792644 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-credential-socket\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.792826 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-certs\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.793064 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.792841 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-data\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.793064 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.793016 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-socket\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.793417 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.793394 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/232fb082-0530-45cf-a429-ce3cc0a6ea12-istiod-ca-cert\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.795024 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.794998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-envoy\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.795468 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.795434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-podinfo\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.804470 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.804443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-token\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.804665 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.804540 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5265h\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-kube-api-access-5265h\") pod \"e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.833600 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.833556 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:28.989424 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.989389 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm"] Jul 22 14:26:28.992598 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:26:28.992564 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232fb082_0530_45cf_a429_ce3cc0a6ea12.slice/crio-ff96d81d84c8aa8e611363ba070721ccd956a4ee201352109c0318cddabc5925 WatchSource:0}: Error finding container ff96d81d84c8aa8e611363ba070721ccd956a4ee201352109c0318cddabc5925: Status 404 returned error can't find the container with id ff96d81d84c8aa8e611363ba070721ccd956a4ee201352109c0318cddabc5925 Jul 22 14:26:28.994658 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.994624 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:28.994761 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.994690 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:28.994761 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:28.994722 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:29.135809 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:29.135774 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:29.195752 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:29.195712 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:29.987408 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:29.987369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" event={"ID":"232fb082-0530-45cf-a429-ce3cc0a6ea12","Type":"ContainerStarted","Data":"29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5"} Jul 22 14:26:29.987841 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:29.987437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" event={"ID":"232fb082-0530-45cf-a429-ce3cc0a6ea12","Type":"ContainerStarted","Data":"ff96d81d84c8aa8e611363ba070721ccd956a4ee201352109c0318cddabc5925"} Jul 22 14:26:30.009786 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:30.009730 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podStartSLOduration=2.009714147 podStartE2EDuration="2.009714147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:26:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:26:30.007059001 +0000 UTC m=+2416.657075065" watchObservedRunningTime="2026-07-22 14:26:30.009714147 +0000 UTC m=+2416.659730189" Jul 22 14:26:30.833984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:30.833947 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:30.839385 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:30.839358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:30.993066 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:30.993029 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:30.993987 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:30.993967 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:32.270342 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.270305 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:32.371523 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.371489 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:32.489644 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.489587 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:32.793609 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.793585 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:26:32.879984 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.879952 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:32.932863 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.932825 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-credential-socket\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.932873 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-socket\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.932904 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-envoy\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933029 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-podinfo\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933081 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-token\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933122 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933112 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86422ec0-cfec-4a65-93c1-29bed1d08e73-istiod-ca-cert\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933401 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933155 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:32.933401 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933216 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-data\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933401 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933288 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:32.933401 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933319 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-certs\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933401 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933386 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg8g5\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-kube-api-access-tg8g5\") pod \"86422ec0-cfec-4a65-93c1-29bed1d08e73\" (UID: \"86422ec0-cfec-4a65-93c1-29bed1d08e73\") " Jul 22 14:26:32.933671 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933548 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86422ec0-cfec-4a65-93c1-29bed1d08e73-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:26:32.933671 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933637 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:32.933928 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933894 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:32.934069 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933947 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86422ec0-cfec-4a65-93c1-29bed1d08e73-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:32.934069 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933966 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:32.934069 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.933980 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:32.934348 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.934322 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-data" (OuterVolumeSpecName: "istio-data") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:32.935425 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.935391 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:26:32.935530 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.935448 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:26:32.935589 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.935546 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-kube-api-access-tg8g5" (OuterVolumeSpecName: "kube-api-access-tg8g5") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "kube-api-access-tg8g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:26:32.935992 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.935970 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-token" (OuterVolumeSpecName: "istio-token") pod "86422ec0-cfec-4a65-93c1-29bed1d08e73" (UID: "86422ec0-cfec-4a65-93c1-29bed1d08e73"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:26:32.975438 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:32.975403 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:33.004299 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.004271 2556 generic.go:356] "Generic (PLEG): container finished" podID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerID="b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf" exitCode=0 Jul 22 14:26:33.004462 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.004320 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" Jul 22 14:26:33.004462 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.004359 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" event={"ID":"86422ec0-cfec-4a65-93c1-29bed1d08e73","Type":"ContainerDied","Data":"b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf"} Jul 22 14:26:33.004462 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.004407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5" event={"ID":"86422ec0-cfec-4a65-93c1-29bed1d08e73","Type":"ContainerDied","Data":"109b9492cd10cbbbd713fa97ba53347149a599accda7ff90181fbe884c7e7344"} Jul 22 14:26:33.004462 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.004431 2556 scope.go:117] "RemoveContainer" containerID="b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf" Jul 22 14:26:33.014671 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.014655 2556 scope.go:117] "RemoveContainer" containerID="51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17" Jul 22 14:26:33.023182 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.023165 2556 scope.go:117] "RemoveContainer" containerID="b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf" Jul 22 14:26:33.023435 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:26:33.023416 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf\": container with ID starting with b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf not found: ID does not exist" containerID="b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf" Jul 22 14:26:33.023494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.023444 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf"} err="failed to get container status \"b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf\": rpc error: code = NotFound desc = could not find container \"b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf\": container with ID starting with b9d1e6a3c4581dba081409ab3f2c6911a238eff5ef1c839cd6cf1b1298bcf0cf not found: ID does not exist" Jul 22 14:26:33.023494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.023461 2556 scope.go:117] "RemoveContainer" containerID="51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17" Jul 22 14:26:33.023727 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:26:33.023709 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17\": container with ID starting with 51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17 not found: ID does not exist" containerID="51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17" Jul 22 14:26:33.023775 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.023732 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17"} err="failed to get container status \"51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17\": rpc error: code = NotFound desc = could not find container \"51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17\": container with ID starting with 51eca855d7b1b0fe56b9c854607d3c6fc1dccd09141b633db52f62b6cf5e6a17 not found: ID does not exist" Jul 22 14:26:33.031406 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.031371 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5"] Jul 22 14:26:33.035266 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.035240 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:33.035400 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.035271 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:33.035400 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.035285 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:33.035400 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.035299 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86422ec0-cfec-4a65-93c1-29bed1d08e73-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:33.035400 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.035311 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg8g5\" (UniqueName: \"kubernetes.io/projected/86422ec0-cfec-4a65-93c1-29bed1d08e73-kube-api-access-tg8g5\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:26:33.043637 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.043609 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dba614-openshift-default-575b7f4c49-jkvt5"] Jul 22 14:26:33.823928 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:33.823888 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" path="/var/lib/kubelet/pods/86422ec0-cfec-4a65-93c1-29bed1d08e73/volumes" Jul 22 14:26:36.580567 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:36.580470 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:36.945866 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:36.945829 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:37.253219 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.253131 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5"] Jul 22 14:26:37.253753 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.253732 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" Jul 22 14:26:37.253819 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.253757 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" Jul 22 14:26:37.253901 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.253888 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" Jul 22 14:26:37.258886 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.258862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.263354 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.263335 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f0b3df-openshift-default-dockercfg-r5cl9\"" Jul 22 14:26:37.269023 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.268999 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5"] Jul 22 14:26:37.301673 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.301642 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:37.376358 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376317 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-socket\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istiod-ca-cert\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hsfp\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-kube-api-access-5hsfp\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-certs\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-credential-socket\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376775 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376563 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-token\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376775 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-data\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376775 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376639 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-podinfo\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.376775 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.376678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-envoy\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.428781 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.428747 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:37.477566 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477534 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-socket\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477566 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istiod-ca-cert\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477788 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hsfp\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-kube-api-access-5hsfp\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477788 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-certs\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477788 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-credential-socket\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477788 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-token\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477788 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-data\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.477788 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-podinfo\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.478129 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.477815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-envoy\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.478129 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.478034 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-socket\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.478129 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.478057 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-certs\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.478295 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.478229 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-credential-socket\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.478385 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.478364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-data\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.478439 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.478406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istiod-ca-cert\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.480045 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.480028 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-envoy\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.480487 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.480468 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-podinfo\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.490082 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.490062 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hsfp\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-kube-api-access-5hsfp\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.490277 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.490263 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-token\") pod \"e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.571415 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.571325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:37.655069 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.655037 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:37.721731 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.721702 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5"] Jul 22 14:26:37.723388 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:26:37.723363 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e91f11_dfd0_4d27_94b2_2f1d95c5c8be.slice/crio-8c5a7820c6dbc0ed67528b49d013b9d770220284581648b4901b55021ee73eea WatchSource:0}: Error finding container 8c5a7820c6dbc0ed67528b49d013b9d770220284581648b4901b55021ee73eea: Status 404 returned error can't find the container with id 8c5a7820c6dbc0ed67528b49d013b9d770220284581648b4901b55021ee73eea Jul 22 14:26:37.725471 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.725436 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:37.725592 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.725535 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:37.725668 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:37.725587 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:38.044465 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:38.044422 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" event={"ID":"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be","Type":"ContainerStarted","Data":"3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce"} Jul 22 14:26:38.044629 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:38.044524 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" event={"ID":"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be","Type":"ContainerStarted","Data":"8c5a7820c6dbc0ed67528b49d013b9d770220284581648b4901b55021ee73eea"} Jul 22 14:26:38.073343 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:38.073290 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podStartSLOduration=1.073274972 podStartE2EDuration="1.073274972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:26:38.069752357 +0000 UTC m=+2424.719768395" watchObservedRunningTime="2026-07-22 14:26:38.073274972 +0000 UTC m=+2424.723291011" Jul 22 14:26:38.572500 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:38.572455 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:38.583664 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:38.583626 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:39.050252 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:39.050219 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:39.051253 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:39.051230 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:40.053257 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:40.053211 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:40.158510 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:40.158423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:40.275281 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:40.275205 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:40.369833 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:40.369791 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:41.040187 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:41.040136 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:41.149971 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:41.149936 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:42.100611 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:42.100577 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:42.204319 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:42.204283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:44.580404 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:44.580369 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:45.995003 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:45.994966 2556 patch_prober.go:28] interesting pod/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 22 14:26:45.995452 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:45.995035 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 22 14:26:46.099864 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:46.099830 2556 generic.go:356] "Generic (PLEG): container finished" podID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerID="29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5" exitCode=0 Jul 22 14:26:46.100055 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:46.099902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" event={"ID":"232fb082-0530-45cf-a429-ce3cc0a6ea12","Type":"ContainerDied","Data":"29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5"} Jul 22 14:26:46.100333 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:46.100320 2556 scope.go:117] "RemoveContainer" containerID="29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5" Jul 22 14:26:46.101384 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:46.101353 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:46.101499 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:46.101427 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:46.101499 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:46.101467 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:47.107002 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:47.106966 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" event={"ID":"232fb082-0530-45cf-a429-ce3cc0a6ea12","Type":"ContainerStarted","Data":"999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097"} Jul 22 14:26:47.833694 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:47.833661 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:47.834033 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:47.834009 2556 patch_prober.go:28] interesting pod/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 22 14:26:47.834107 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:47.834062 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 22 14:26:48.834414 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:48.834374 2556 patch_prober.go:28] interesting pod/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 22 14:26:48.834816 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:48.834438 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 22 14:26:49.834701 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:49.834667 2556 patch_prober.go:28] interesting pod/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 22 14:26:49.835133 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:49.834714 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 22 14:26:50.834840 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:50.834795 2556 patch_prober.go:28] interesting pod/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 22 14:26:50.835351 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:50.834858 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 22 14:26:51.838544 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:51.838465 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:51.838884 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:51.838842 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:51.839446 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:51.839428 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:26:53.331081 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:53.331044 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:53.432314 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:53.432281 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:53.806435 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:53.806394 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:53.907192 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:53.907153 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:26:54.380015 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:54.379983 2556 patch_prober.go:28] interesting pod/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:58456->10.132.0.69:15021: read: connection reset by peer" start-of-body= Jul 22 14:26:54.380431 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:54.380049 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:58456->10.132.0.69:15021: read: connection reset by peer" Jul 22 14:26:55.157172 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:55.157135 2556 generic.go:356] "Generic (PLEG): container finished" podID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerID="3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce" exitCode=0 Jul 22 14:26:55.157356 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:55.157208 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" event={"ID":"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be","Type":"ContainerDied","Data":"3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce"} Jul 22 14:26:55.157607 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:55.157590 2556 scope.go:117] "RemoveContainer" containerID="3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce" Jul 22 14:26:55.158594 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:55.158563 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:55.158666 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:55.158650 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:55.158708 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:55.158692 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 14:26:56.164464 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:56.164431 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" event={"ID":"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be","Type":"ContainerStarted","Data":"76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a"} Jul 22 14:26:56.572338 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:56.572252 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:26:56.572503 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:56.572449 2556 patch_prober.go:28] interesting pod/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 22 14:26:56.572574 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:56.572502 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 22 14:26:57.572601 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:57.572561 2556 patch_prober.go:28] interesting pod/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 22 14:26:57.573255 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:57.573221 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 22 14:26:58.572851 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:58.572805 2556 patch_prober.go:28] interesting pod/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 22 14:26:58.573391 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:58.572875 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 22 14:26:59.575931 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:59.575282 2556 patch_prober.go:28] interesting pod/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 22 14:26:59.575931 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:59.575344 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 22 14:26:59.595484 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:26:59.595446 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:27:00.572223 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:00.571751 2556 patch_prober.go:28] interesting pod/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 22 14:27:00.572223 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:00.571817 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 22 14:27:01.575670 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:01.575637 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:27:01.576172 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:01.576041 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:27:01.576728 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:01.576708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:27:03.053289 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:03.053249 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:27:03.156830 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:03.156787 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:27:31.492555 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:27:31.492520 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:29:42.430310 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:29:42.430223 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:29:45.388160 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:29:45.388122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:29:50.757250 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:29:50.757208 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:30:14.999321 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:30:14.999289 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:08.460100 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:08.460010 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:08.764153 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:08.764064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:09.281935 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:09.281879 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:14.015225 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:14.015194 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:31:14.023283 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:14.023261 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:31:20.189457 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:20.189423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:29.387282 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:29.387251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:29.488133 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:29.488101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:30.431506 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:30.431466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:48.350180 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:48.350138 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:54.601055 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:54.601023 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:31:54.702327 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:31:54.702294 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:03.835755 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:03.835716 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:03.935261 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:03.935229 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:30.734547 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:30.734511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:31.670545 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:31.670508 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:32.657071 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.657033 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-140515782317744"] Jul 22 14:32:32.657461 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.657438 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" Jul 22 14:32:32.657461 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.657449 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" Jul 22 14:32:32.657535 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.657530 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="86422ec0-cfec-4a65-93c1-29bed1d08e73" containerName="istio-proxy" Jul 22 14:32:32.660518 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.660502 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:32.663318 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.663107 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-47wr4\"" Jul 22 14:32:32.668048 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.668013 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782317744"] Jul 22 14:32:32.752817 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.752773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2l5h\" (UniqueName: \"kubernetes.io/projected/cf442953-9e9f-49f0-9f89-f1b305b8c615-kube-api-access-b2l5h\") pod \"test-curl-7614-140515782317744\" (UID: \"cf442953-9e9f-49f0-9f89-f1b305b8c615\") " pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:32.853932 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.853862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2l5h\" (UniqueName: \"kubernetes.io/projected/cf442953-9e9f-49f0-9f89-f1b305b8c615-kube-api-access-b2l5h\") pod \"test-curl-7614-140515782317744\" (UID: \"cf442953-9e9f-49f0-9f89-f1b305b8c615\") " pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:32.869364 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.869327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2l5h\" (UniqueName: \"kubernetes.io/projected/cf442953-9e9f-49f0-9f89-f1b305b8c615-kube-api-access-b2l5h\") pod \"test-curl-7614-140515782317744\" (UID: \"cf442953-9e9f-49f0-9f89-f1b305b8c615\") " pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:32.976785 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:32.976701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:33.119332 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:33.119307 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782317744"] Jul 22 14:32:33.121619 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:32:33.121585 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf442953_9e9f_49f0_9f89_f1b305b8c615.slice/crio-6e78cd4405934982aaf0b4a097f98dbf4e101416c36fcda18cd9ee57941acbf5 WatchSource:0}: Error finding container 6e78cd4405934982aaf0b4a097f98dbf4e101416c36fcda18cd9ee57941acbf5: Status 404 returned error can't find the container with id 6e78cd4405934982aaf0b4a097f98dbf4e101416c36fcda18cd9ee57941acbf5 Jul 22 14:32:33.123029 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:33.123012 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 14:32:34.057134 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:34.057097 2556 generic.go:356] "Generic (PLEG): container finished" podID="cf442953-9e9f-49f0-9f89-f1b305b8c615" containerID="5eef5a6b1ad2aaf672cee1153b167a7dae55a0362de8eb7b8307382c722ae4ae" exitCode=0 Jul 22 14:32:34.057552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:34.057192 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782317744" event={"ID":"cf442953-9e9f-49f0-9f89-f1b305b8c615","Type":"ContainerDied","Data":"5eef5a6b1ad2aaf672cee1153b167a7dae55a0362de8eb7b8307382c722ae4ae"} Jul 22 14:32:34.057552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:34.057249 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782317744" event={"ID":"cf442953-9e9f-49f0-9f89-f1b305b8c615","Type":"ContainerStarted","Data":"6e78cd4405934982aaf0b4a097f98dbf4e101416c36fcda18cd9ee57941acbf5"} Jul 22 14:32:35.198868 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.198843 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:35.220560 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.220531 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-140515782317744_cf442953-9e9f-49f0-9f89-f1b305b8c615/test-curl-7614-140515782317744/0.log" Jul 22 14:32:35.245606 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.245578 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-140515782317744"] Jul 22 14:32:35.252308 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.252279 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-140515782317744"] Jul 22 14:32:35.275807 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.275782 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2l5h\" (UniqueName: \"kubernetes.io/projected/cf442953-9e9f-49f0-9f89-f1b305b8c615-kube-api-access-b2l5h\") pod \"cf442953-9e9f-49f0-9f89-f1b305b8c615\" (UID: \"cf442953-9e9f-49f0-9f89-f1b305b8c615\") " Jul 22 14:32:35.277975 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.277950 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf442953-9e9f-49f0-9f89-f1b305b8c615-kube-api-access-b2l5h" (OuterVolumeSpecName: "kube-api-access-b2l5h") pod "cf442953-9e9f-49f0-9f89-f1b305b8c615" (UID: "cf442953-9e9f-49f0-9f89-f1b305b8c615"). InnerVolumeSpecName "kube-api-access-b2l5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:32:35.377517 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.377483 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2l5h\" (UniqueName: \"kubernetes.io/projected/cf442953-9e9f-49f0-9f89-f1b305b8c615-kube-api-access-b2l5h\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:32:35.385798 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.385772 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-140515782319408"] Jul 22 14:32:35.386219 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.386205 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf442953-9e9f-49f0-9f89-f1b305b8c615" containerName="test-curl-7614-140515782317744" Jul 22 14:32:35.386267 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.386220 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf442953-9e9f-49f0-9f89-f1b305b8c615" containerName="test-curl-7614-140515782317744" Jul 22 14:32:35.386301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.386292 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf442953-9e9f-49f0-9f89-f1b305b8c615" containerName="test-curl-7614-140515782317744" Jul 22 14:32:35.389084 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.389069 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:35.395998 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.395977 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782319408"] Jul 22 14:32:35.478160 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.478128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w742l\" (UniqueName: \"kubernetes.io/projected/a90eeab3-549d-4aab-8eb9-44735c0caf04-kube-api-access-w742l\") pod \"test-curl-7614-140515782319408\" (UID: \"a90eeab3-549d-4aab-8eb9-44735c0caf04\") " pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:35.578873 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.578797 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w742l\" (UniqueName: \"kubernetes.io/projected/a90eeab3-549d-4aab-8eb9-44735c0caf04-kube-api-access-w742l\") pod \"test-curl-7614-140515782319408\" (UID: \"a90eeab3-549d-4aab-8eb9-44735c0caf04\") " pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:35.588765 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.588746 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w742l\" (UniqueName: \"kubernetes.io/projected/a90eeab3-549d-4aab-8eb9-44735c0caf04-kube-api-access-w742l\") pod \"test-curl-7614-140515782319408\" (UID: \"a90eeab3-549d-4aab-8eb9-44735c0caf04\") " pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:35.699873 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.699797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:35.829952 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.829279 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf442953-9e9f-49f0-9f89-f1b305b8c615" path="/var/lib/kubelet/pods/cf442953-9e9f-49f0-9f89-f1b305b8c615/volumes" Jul 22 14:32:35.835972 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:35.835899 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782319408"] Jul 22 14:32:35.836957 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:32:35.836931 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda90eeab3_549d_4aab_8eb9_44735c0caf04.slice/crio-7c93c61536969b68e603849a17d236d3d7c4fe72c9d6dfd377ce4e79725f64ef WatchSource:0}: Error finding container 7c93c61536969b68e603849a17d236d3d7c4fe72c9d6dfd377ce4e79725f64ef: Status 404 returned error can't find the container with id 7c93c61536969b68e603849a17d236d3d7c4fe72c9d6dfd377ce4e79725f64ef Jul 22 14:32:36.068871 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:36.068781 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782319408" event={"ID":"a90eeab3-549d-4aab-8eb9-44735c0caf04","Type":"ContainerStarted","Data":"7c93c61536969b68e603849a17d236d3d7c4fe72c9d6dfd377ce4e79725f64ef"} Jul 22 14:32:36.070100 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:36.070078 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782317744" Jul 22 14:32:36.070203 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:36.070134 2556 scope.go:117] "RemoveContainer" containerID="5eef5a6b1ad2aaf672cee1153b167a7dae55a0362de8eb7b8307382c722ae4ae" Jul 22 14:32:37.076616 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:37.076577 2556 generic.go:356] "Generic (PLEG): container finished" podID="a90eeab3-549d-4aab-8eb9-44735c0caf04" containerID="57bd9135f5adf30f5a3ffa2f1507ab41cf11421402aff29a45085fc8100ac161" exitCode=0 Jul 22 14:32:37.077097 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:37.076670 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782319408" event={"ID":"a90eeab3-549d-4aab-8eb9-44735c0caf04","Type":"ContainerDied","Data":"57bd9135f5adf30f5a3ffa2f1507ab41cf11421402aff29a45085fc8100ac161"} Jul 22 14:32:38.222347 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.222323 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:38.240800 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.240721 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-140515782319408_a90eeab3-549d-4aab-8eb9-44735c0caf04/test-curl-7614-140515782319408/0.log" Jul 22 14:32:38.267936 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.267887 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-140515782319408"] Jul 22 14:32:38.272034 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.272008 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-140515782319408"] Jul 22 14:32:38.301704 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.301680 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w742l\" (UniqueName: \"kubernetes.io/projected/a90eeab3-549d-4aab-8eb9-44735c0caf04-kube-api-access-w742l\") pod \"a90eeab3-549d-4aab-8eb9-44735c0caf04\" (UID: \"a90eeab3-549d-4aab-8eb9-44735c0caf04\") " Jul 22 14:32:38.303790 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.303768 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90eeab3-549d-4aab-8eb9-44735c0caf04-kube-api-access-w742l" (OuterVolumeSpecName: "kube-api-access-w742l") pod "a90eeab3-549d-4aab-8eb9-44735c0caf04" (UID: "a90eeab3-549d-4aab-8eb9-44735c0caf04"). InnerVolumeSpecName "kube-api-access-w742l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:32:38.402594 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.402564 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w742l\" (UniqueName: \"kubernetes.io/projected/a90eeab3-549d-4aab-8eb9-44735c0caf04-kube-api-access-w742l\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:32:38.442306 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.442280 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:38.442663 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.442647 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90eeab3-549d-4aab-8eb9-44735c0caf04" containerName="test-curl-7614-140515782319408" Jul 22 14:32:38.442706 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.442664 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90eeab3-549d-4aab-8eb9-44735c0caf04" containerName="test-curl-7614-140515782319408" Jul 22 14:32:38.442754 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.442745 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90eeab3-549d-4aab-8eb9-44735c0caf04" containerName="test-curl-7614-140515782319408" Jul 22 14:32:38.445815 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.445800 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:38.449895 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.449874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:38.604669 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.604643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwkxz\" (UniqueName: \"kubernetes.io/projected/4847a6d4-8f21-4874-b6bb-85993c976df1-kube-api-access-dwkxz\") pod \"test-curl-7614-140515782235168\" (UID: \"4847a6d4-8f21-4874-b6bb-85993c976df1\") " pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:38.705296 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.705218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkxz\" (UniqueName: \"kubernetes.io/projected/4847a6d4-8f21-4874-b6bb-85993c976df1-kube-api-access-dwkxz\") pod \"test-curl-7614-140515782235168\" (UID: \"4847a6d4-8f21-4874-b6bb-85993c976df1\") " pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:38.713736 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.713712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwkxz\" (UniqueName: \"kubernetes.io/projected/4847a6d4-8f21-4874-b6bb-85993c976df1-kube-api-access-dwkxz\") pod \"test-curl-7614-140515782235168\" (UID: \"4847a6d4-8f21-4874-b6bb-85993c976df1\") " pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:38.757690 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.757669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:38.891714 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:38.891691 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:38.893698 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:32:38.893671 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4847a6d4_8f21_4874_b6bb_85993c976df1.slice/crio-c17dacb793b735d628a0f6e466e31ac6b545e8c86c86994e62661484dd94d856 WatchSource:0}: Error finding container c17dacb793b735d628a0f6e466e31ac6b545e8c86c86994e62661484dd94d856: Status 404 returned error can't find the container with id c17dacb793b735d628a0f6e466e31ac6b545e8c86c86994e62661484dd94d856 Jul 22 14:32:39.089170 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:39.089085 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:39.089170 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:39.089106 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c93c61536969b68e603849a17d236d3d7c4fe72c9d6dfd377ce4e79725f64ef" Jul 22 14:32:39.090400 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:39.090376 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782235168" event={"ID":"4847a6d4-8f21-4874-b6bb-85993c976df1","Type":"ContainerStarted","Data":"c17dacb793b735d628a0f6e466e31ac6b545e8c86c86994e62661484dd94d856"} Jul 22 14:32:39.099128 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:32:39.099103 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7614-140515782319408\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="a90eeab3-549d-4aab-8eb9-44735c0caf04" pod="opendatahub/test-curl-7614-140515782319408" Jul 22 14:32:39.821880 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:39.821844 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90eeab3-549d-4aab-8eb9-44735c0caf04" path="/var/lib/kubelet/pods/a90eeab3-549d-4aab-8eb9-44735c0caf04/volumes" Jul 22 14:32:40.099138 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:40.099107 2556 generic.go:356] "Generic (PLEG): container finished" podID="4847a6d4-8f21-4874-b6bb-85993c976df1" containerID="1e0c528fd4fca50eda9990b81e30af7c6404a7d7510cb7563bb7fa70130d801f" exitCode=0 Jul 22 14:32:40.099307 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:40.099193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782235168" event={"ID":"4847a6d4-8f21-4874-b6bb-85993c976df1","Type":"ContainerDied","Data":"1e0c528fd4fca50eda9990b81e30af7c6404a7d7510cb7563bb7fa70130d801f"} Jul 22 14:32:41.248104 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.248078 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:41.268038 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.268011 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-140515782235168_4847a6d4-8f21-4874-b6bb-85993c976df1/test-curl-7614-140515782235168/0.log" Jul 22 14:32:41.290852 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.290822 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:41.296947 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.296920 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:41.329897 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.329871 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwkxz\" (UniqueName: \"kubernetes.io/projected/4847a6d4-8f21-4874-b6bb-85993c976df1-kube-api-access-dwkxz\") pod \"4847a6d4-8f21-4874-b6bb-85993c976df1\" (UID: \"4847a6d4-8f21-4874-b6bb-85993c976df1\") " Jul 22 14:32:41.332106 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.332078 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4847a6d4-8f21-4874-b6bb-85993c976df1-kube-api-access-dwkxz" (OuterVolumeSpecName: "kube-api-access-dwkxz") pod "4847a6d4-8f21-4874-b6bb-85993c976df1" (UID: "4847a6d4-8f21-4874-b6bb-85993c976df1"). InnerVolumeSpecName "kube-api-access-dwkxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:32:41.430401 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.430314 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:41.430757 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.430733 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwkxz\" (UniqueName: \"kubernetes.io/projected/4847a6d4-8f21-4874-b6bb-85993c976df1-kube-api-access-dwkxz\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:32:41.430832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.430774 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4847a6d4-8f21-4874-b6bb-85993c976df1" containerName="test-curl-7614-140515782235168" Jul 22 14:32:41.430832 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.430787 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4847a6d4-8f21-4874-b6bb-85993c976df1" containerName="test-curl-7614-140515782235168" Jul 22 14:32:41.430934 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.430846 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4847a6d4-8f21-4874-b6bb-85993c976df1" containerName="test-curl-7614-140515782235168" Jul 22 14:32:41.433862 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.433847 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:41.440737 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.440712 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:41.531555 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.531521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp5jz\" (UniqueName: \"kubernetes.io/projected/545598e6-74ac-4434-a736-35a4a27f9e0d-kube-api-access-rp5jz\") pod \"test-curl-7614-140515782235168\" (UID: \"545598e6-74ac-4434-a736-35a4a27f9e0d\") " pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:41.632742 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.632707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp5jz\" (UniqueName: \"kubernetes.io/projected/545598e6-74ac-4434-a736-35a4a27f9e0d-kube-api-access-rp5jz\") pod \"test-curl-7614-140515782235168\" (UID: \"545598e6-74ac-4434-a736-35a4a27f9e0d\") " pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:41.641436 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.641406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp5jz\" (UniqueName: \"kubernetes.io/projected/545598e6-74ac-4434-a736-35a4a27f9e0d-kube-api-access-rp5jz\") pod \"test-curl-7614-140515782235168\" (UID: \"545598e6-74ac-4434-a736-35a4a27f9e0d\") " pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:41.744233 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.744151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:41.822548 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:41.822516 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4847a6d4-8f21-4874-b6bb-85993c976df1" path="/var/lib/kubelet/pods/4847a6d4-8f21-4874-b6bb-85993c976df1/volumes" Jul 22 14:32:42.085080 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:42.085056 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:42.086591 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:32:42.086567 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod545598e6_74ac_4434_a736_35a4a27f9e0d.slice/crio-dc449cb466e7c0907139c5a342cf71faf053ce9e65eb2157531c275370d8b46e WatchSource:0}: Error finding container dc449cb466e7c0907139c5a342cf71faf053ce9e65eb2157531c275370d8b46e: Status 404 returned error can't find the container with id dc449cb466e7c0907139c5a342cf71faf053ce9e65eb2157531c275370d8b46e Jul 22 14:32:42.113156 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:42.113126 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:42.113328 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:42.113134 2556 scope.go:117] "RemoveContainer" containerID="1e0c528fd4fca50eda9990b81e30af7c6404a7d7510cb7563bb7fa70130d801f" Jul 22 14:32:42.114536 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:42.114422 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782235168" event={"ID":"545598e6-74ac-4434-a736-35a4a27f9e0d","Type":"ContainerStarted","Data":"dc449cb466e7c0907139c5a342cf71faf053ce9e65eb2157531c275370d8b46e"} Jul 22 14:32:43.122251 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:43.122222 2556 generic.go:356] "Generic (PLEG): container finished" podID="545598e6-74ac-4434-a736-35a4a27f9e0d" containerID="fae2a91b2e165959bcbc7a84830f4030ce6b80a3dabe7ff9aed2ea8edd4eab2f" exitCode=0 Jul 22 14:32:43.122639 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:43.122305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782235168" event={"ID":"545598e6-74ac-4434-a736-35a4a27f9e0d","Type":"ContainerDied","Data":"fae2a91b2e165959bcbc7a84830f4030ce6b80a3dabe7ff9aed2ea8edd4eab2f"} Jul 22 14:32:44.263080 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.263052 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:44.286754 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.286730 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-140515782235168_545598e6-74ac-4434-a736-35a4a27f9e0d/test-curl-7614-140515782235168/0.log" Jul 22 14:32:44.313280 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.313241 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:44.316681 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.316661 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-140515782235168"] Jul 22 14:32:44.359528 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.359500 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp5jz\" (UniqueName: \"kubernetes.io/projected/545598e6-74ac-4434-a736-35a4a27f9e0d-kube-api-access-rp5jz\") pod \"545598e6-74ac-4434-a736-35a4a27f9e0d\" (UID: \"545598e6-74ac-4434-a736-35a4a27f9e0d\") " Jul 22 14:32:44.361567 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.361535 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545598e6-74ac-4434-a736-35a4a27f9e0d-kube-api-access-rp5jz" (OuterVolumeSpecName: "kube-api-access-rp5jz") pod "545598e6-74ac-4434-a736-35a4a27f9e0d" (UID: "545598e6-74ac-4434-a736-35a4a27f9e0d"). InnerVolumeSpecName "kube-api-access-rp5jz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:32:44.445121 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.445054 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7614-140515782236176"] Jul 22 14:32:44.445491 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.445477 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545598e6-74ac-4434-a736-35a4a27f9e0d" containerName="test-curl-7614-140515782235168" Jul 22 14:32:44.445538 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.445493 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="545598e6-74ac-4434-a736-35a4a27f9e0d" containerName="test-curl-7614-140515782235168" Jul 22 14:32:44.445580 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.445570 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="545598e6-74ac-4434-a736-35a4a27f9e0d" containerName="test-curl-7614-140515782235168" Jul 22 14:32:44.448517 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.448500 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:44.460627 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.460503 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp5jz\" (UniqueName: \"kubernetes.io/projected/545598e6-74ac-4434-a736-35a4a27f9e0d-kube-api-access-rp5jz\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:32:44.462790 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.462759 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"] Jul 22 14:32:44.561429 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.561397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxprv\" (UniqueName: \"kubernetes.io/projected/9535349a-4cd4-4807-b373-0a6e71d06e74-kube-api-access-vxprv\") pod \"test-curl-7614-140515782236176\" (UID: \"9535349a-4cd4-4807-b373-0a6e71d06e74\") " pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:44.662269 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.662242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxprv\" (UniqueName: \"kubernetes.io/projected/9535349a-4cd4-4807-b373-0a6e71d06e74-kube-api-access-vxprv\") pod \"test-curl-7614-140515782236176\" (UID: \"9535349a-4cd4-4807-b373-0a6e71d06e74\") " pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:44.670477 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.670454 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxprv\" (UniqueName: \"kubernetes.io/projected/9535349a-4cd4-4807-b373-0a6e71d06e74-kube-api-access-vxprv\") pod \"test-curl-7614-140515782236176\" (UID: \"9535349a-4cd4-4807-b373-0a6e71d06e74\") " pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:44.757704 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.757621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:44.895001 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:44.894955 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"] Jul 22 14:32:45.134918 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:45.134870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782236176" event={"ID":"9535349a-4cd4-4807-b373-0a6e71d06e74","Type":"ContainerStarted","Data":"540359ed2521e1f4c79fdc49c197d5b160d8af82d3489f234cadc728bbd98168"} Jul 22 14:32:45.136045 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:45.136026 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:45.136165 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:45.136060 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc449cb466e7c0907139c5a342cf71faf053ce9e65eb2157531c275370d8b46e" Jul 22 14:32:45.146093 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:32:45.146066 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7614-140515782235168\" is forbidden: User \"system:node:ip-10-0-140-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-215.ec2.internal' and this object" podUID="545598e6-74ac-4434-a736-35a4a27f9e0d" pod="opendatahub/test-curl-7614-140515782235168" Jul 22 14:32:45.822063 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:45.822032 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545598e6-74ac-4434-a736-35a4a27f9e0d" path="/var/lib/kubelet/pods/545598e6-74ac-4434-a736-35a4a27f9e0d/volumes" Jul 22 14:32:46.145184 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:46.145149 2556 generic.go:356] "Generic (PLEG): container finished" podID="9535349a-4cd4-4807-b373-0a6e71d06e74" containerID="3b7e51ff8c4e40ef4eed08d754a242b558e6b3ac2caaeebecfcae0bf0eca4aaf" exitCode=0 Jul 22 14:32:46.145363 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:46.145232 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7614-140515782236176" event={"ID":"9535349a-4cd4-4807-b373-0a6e71d06e74","Type":"ContainerDied","Data":"3b7e51ff8c4e40ef4eed08d754a242b558e6b3ac2caaeebecfcae0bf0eca4aaf"} Jul 22 14:32:47.290945 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.290896 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:47.312445 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.312413 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7614-140515782236176_9535349a-4cd4-4807-b373-0a6e71d06e74/test-curl-7614-140515782236176/0.log" Jul 22 14:32:47.338554 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.338523 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"] Jul 22 14:32:47.340720 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.340698 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7614-140515782236176"] Jul 22 14:32:47.389643 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.389617 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxprv\" (UniqueName: \"kubernetes.io/projected/9535349a-4cd4-4807-b373-0a6e71d06e74-kube-api-access-vxprv\") pod \"9535349a-4cd4-4807-b373-0a6e71d06e74\" (UID: \"9535349a-4cd4-4807-b373-0a6e71d06e74\") " Jul 22 14:32:47.391622 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.391589 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9535349a-4cd4-4807-b373-0a6e71d06e74-kube-api-access-vxprv" (OuterVolumeSpecName: "kube-api-access-vxprv") pod "9535349a-4cd4-4807-b373-0a6e71d06e74" (UID: "9535349a-4cd4-4807-b373-0a6e71d06e74"). InnerVolumeSpecName "kube-api-access-vxprv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:32:47.490987 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.490901 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxprv\" (UniqueName: \"kubernetes.io/projected/9535349a-4cd4-4807-b373-0a6e71d06e74-kube-api-access-vxprv\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:32:47.822109 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:47.822031 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9535349a-4cd4-4807-b373-0a6e71d06e74" path="/var/lib/kubelet/pods/9535349a-4cd4-4807-b373-0a6e71d06e74/volumes" Jul 22 14:32:48.157809 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:48.157783 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7614-140515782236176" Jul 22 14:32:48.158014 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:48.157834 2556 scope.go:117] "RemoveContainer" containerID="3b7e51ff8c4e40ef4eed08d754a242b558e6b3ac2caaeebecfcae0bf0eca4aaf" Jul 22 14:32:48.554411 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:48.554326 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:51.533828 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:51.533790 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:32:51.631296 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:32:51.631265 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:01.408973 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:01.408883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:06.034392 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:06.034358 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:06.470672 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:06.470630 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:12.591373 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:12.591334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:12.691550 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:12.691520 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:12.840744 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:12.840711 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm"] Jul 22 14:33:12.840998 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:12.840974 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" containerID="cri-o://999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097" gracePeriod=30 Jul 22 14:33:12.857562 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:12.857490 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:13.097925 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:13.097869 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:13.899661 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:13.899628 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:14.053275 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:14.053231 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:18.105554 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.105491 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:33:18.178146 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178112 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5265h\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-kube-api-access-5265h\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178323 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178173 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-podinfo\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178323 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178273 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/232fb082-0530-45cf-a429-ce3cc0a6ea12-istiod-ca-cert\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178461 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178328 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-credential-socket\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178461 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178378 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-socket\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178461 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178434 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-envoy\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178634 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178460 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-token\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178634 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178508 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-certs\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178634 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178554 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-data\") pod \"232fb082-0530-45cf-a429-ce3cc0a6ea12\" (UID: \"232fb082-0530-45cf-a429-ce3cc0a6ea12\") " Jul 22 14:33:18.178793 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178656 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:18.178793 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178667 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:18.178793 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178734 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232fb082-0530-45cf-a429-ce3cc0a6ea12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:33:18.178982 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178956 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:18.179043 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.178987 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/232fb082-0530-45cf-a429-ce3cc0a6ea12-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.179043 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.179002 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.179043 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.179011 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.179482 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.179456 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-data" (OuterVolumeSpecName: "istio-data") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:18.180565 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.180532 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-kube-api-access-5265h" (OuterVolumeSpecName: "kube-api-access-5265h") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "kube-api-access-5265h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:33:18.180671 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.180641 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-token" (OuterVolumeSpecName: "istio-token") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:33:18.180722 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.180685 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:33:18.180794 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.180773 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "232fb082-0530-45cf-a429-ce3cc0a6ea12" (UID: "232fb082-0530-45cf-a429-ce3cc0a6ea12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:18.280226 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.280176 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.280226 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.280221 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.280226 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.280231 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.280226 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.280238 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.280226 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.280248 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5265h\" (UniqueName: \"kubernetes.io/projected/232fb082-0530-45cf-a429-ce3cc0a6ea12-kube-api-access-5265h\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.280538 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.280259 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/232fb082-0530-45cf-a429-ce3cc0a6ea12-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:18.336745 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.336709 2556 generic.go:356] "Generic (PLEG): container finished" podID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerID="999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097" exitCode=0 Jul 22 14:33:18.336951 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.336762 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" Jul 22 14:33:18.336951 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.336785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" event={"ID":"232fb082-0530-45cf-a429-ce3cc0a6ea12","Type":"ContainerDied","Data":"999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097"} Jul 22 14:33:18.336951 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.336834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm" event={"ID":"232fb082-0530-45cf-a429-ce3cc0a6ea12","Type":"ContainerDied","Data":"ff96d81d84c8aa8e611363ba070721ccd956a4ee201352109c0318cddabc5925"} Jul 22 14:33:18.336951 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.336857 2556 scope.go:117] "RemoveContainer" containerID="999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097" Jul 22 14:33:18.346647 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.346631 2556 scope.go:117] "RemoveContainer" containerID="29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5" Jul 22 14:33:18.355125 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.355108 2556 scope.go:117] "RemoveContainer" containerID="999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097" Jul 22 14:33:18.355388 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:33:18.355368 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097\": container with ID starting with 999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097 not found: ID does not exist" containerID="999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097" Jul 22 14:33:18.355436 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.355399 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097"} err="failed to get container status \"999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097\": rpc error: code = NotFound desc = could not find container \"999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097\": container with ID starting with 999f43ef2c7e0d390e3cf86060e8f8a5b4fc19411c5c30f1b39dff32a32fe097 not found: ID does not exist" Jul 22 14:33:18.355436 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.355417 2556 scope.go:117] "RemoveContainer" containerID="29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5" Jul 22 14:33:18.355688 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:33:18.355636 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5\": container with ID starting with 29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5 not found: ID does not exist" containerID="29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5" Jul 22 14:33:18.355688 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.355659 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5"} err="failed to get container status \"29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5\": rpc error: code = NotFound desc = could not find container \"29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5\": container with ID starting with 29daacb8c0984c00ccd32e859d523eacb5cc3fb7bfee4c87b4029086f96b64f5 not found: ID does not exist" Jul 22 14:33:18.359992 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.359972 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm"] Jul 22 14:33:18.363859 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:18.363839 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7d1f11-openshift-default-c6b8c44f9-wsbkm"] Jul 22 14:33:19.822320 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:19.822292 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" path="/var/lib/kubelet/pods/232fb082-0530-45cf-a429-ce3cc0a6ea12/volumes" Jul 22 14:33:23.667345 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:23.667305 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:29.591047 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:29.591016 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:29.692340 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:29.692297 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:34.800391 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:34.800349 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:34.874338 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:34.874300 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:35.056596 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:35.056515 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5"] Jul 22 14:33:35.056762 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:35.056715 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" containerID="cri-o://76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a" gracePeriod=30 Jul 22 14:33:35.096833 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:35.096807 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:35.328822 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:35.328741 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:35.815362 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:35.815320 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb94769cf-ffj97_5f58425c-f55c-400e-8755-83399620d5b4/authorino/0.log" Jul 22 14:33:40.305757 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.305732 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:33:40.372988 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.372961 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-envoy\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.372997 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-data\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373017 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-podinfo\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373054 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-socket\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373115 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-credential-socket\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373176 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373165 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-certs\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373201 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-token\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373228 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istiod-ca-cert\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373268 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hsfp\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-kube-api-access-5hsfp\") pod \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\" (UID: \"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be\") " Jul 22 14:33:40.373494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373387 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:40.373494 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373456 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:40.373762 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373574 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:40.373762 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373643 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.373762 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373664 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-credential-socket\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.373925 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373830 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-data" (OuterVolumeSpecName: "istio-data") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:40.373925 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.373848 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 14:33:40.375301 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.375272 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 14:33:40.375479 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.375457 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-token" (OuterVolumeSpecName: "istio-token") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:33:40.375630 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.375613 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 14:33:40.375688 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.375653 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-kube-api-access-5hsfp" (OuterVolumeSpecName: "kube-api-access-5hsfp") pod "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" (UID: "07e91f11-dfd0-4d27-94b2-2f1d95c5c8be"). InnerVolumeSpecName "kube-api-access-5hsfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 14:33:40.455475 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.455433 2556 generic.go:356] "Generic (PLEG): container finished" podID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerID="76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a" exitCode=0 Jul 22 14:33:40.455643 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.455486 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" Jul 22 14:33:40.455643 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.455521 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" event={"ID":"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be","Type":"ContainerDied","Data":"76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a"} Jul 22 14:33:40.455643 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.455586 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5" event={"ID":"07e91f11-dfd0-4d27-94b2-2f1d95c5c8be","Type":"ContainerDied","Data":"8c5a7820c6dbc0ed67528b49d013b9d770220284581648b4901b55021ee73eea"} Jul 22 14:33:40.455643 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.455611 2556 scope.go:117] "RemoveContainer" containerID="76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a" Jul 22 14:33:40.465575 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.465548 2556 scope.go:117] "RemoveContainer" containerID="3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce" Jul 22 14:33:40.473873 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.473851 2556 scope.go:117] "RemoveContainer" containerID="76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a" Jul 22 14:33:40.474161 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:33:40.474139 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a\": container with ID starting with 76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a not found: ID does not exist" containerID="76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a" Jul 22 14:33:40.474253 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474173 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a"} err="failed to get container status \"76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a\": rpc error: code = NotFound desc = could not find container \"76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a\": container with ID starting with 76171d2a1524a0e5f4621910a02c01d26c8d79e6a9ab1d248c89526b5674ae0a not found: ID does not exist" Jul 22 14:33:40.474253 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474192 2556 scope.go:117] "RemoveContainer" containerID="3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce" Jul 22 14:33:40.474385 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474333 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istiod-ca-cert\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474385 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474380 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hsfp\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-kube-api-access-5hsfp\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474526 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474394 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-envoy\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474526 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474408 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-data\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474526 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474420 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-podinfo\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474526 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474431 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-workload-certs\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474526 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474443 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be-istio-token\") on node \"ip-10-0-140-215.ec2.internal\" DevicePath \"\"" Jul 22 14:33:40.474526 ip-10-0-140-215 kubenswrapper[2556]: E0722 14:33:40.474437 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce\": container with ID starting with 3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce not found: ID does not exist" containerID="3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce" Jul 22 14:33:40.474817 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.474497 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce"} err="failed to get container status \"3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce\": rpc error: code = NotFound desc = could not find container \"3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce\": container with ID starting with 3088458aa3603224bee23069931b23747d887d5f8584b54eb8c783fead01c4ce not found: ID does not exist" Jul 22 14:33:40.477365 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.477343 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5"] Jul 22 14:33:40.484298 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:40.484277 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f0b3df-openshift-default-5cb4b4d459-lnmc5"] Jul 22 14:33:41.828716 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:41.828661 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" path="/var/lib/kubelet/pods/07e91f11-dfd0-4d27-94b2-2f1d95c5c8be/volumes" Jul 22 14:33:42.272065 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:42.272028 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-lnlft_707d278c-4c71-49c7-b241-8f17a25bd042/copy-manifests/0.log" Jul 22 14:33:42.279104 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:42.279073 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-lnlft_707d278c-4c71-49c7-b241-8f17a25bd042/manager/0.log" Jul 22 14:33:42.784609 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:42.784571 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-789b85bff9-hm2xf_01af4c5f-c476-436e-99a1-550b89b5013e/maas-api/0.log" Jul 22 14:33:43.274113 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:43.274084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sxhf5_4f6d99ea-1dea-409e-9a3e-c1945d832a80/postgres/0.log" Jul 22 14:33:43.746623 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:43.746592 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:44.101437 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.101411 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz_ac8826b5-834d-4ebe-93cc-70871f971825/util/0.log" Jul 22 14:33:44.108014 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.107992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz_ac8826b5-834d-4ebe-93cc-70871f971825/pull/0.log" Jul 22 14:33:44.114604 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.114584 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz_ac8826b5-834d-4ebe-93cc-70871f971825/extract/0.log" Jul 22 14:33:44.231798 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.231777 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj_03b8af70-366c-4595-a758-7fb566898302/util/0.log" Jul 22 14:33:44.238179 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.238157 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj_03b8af70-366c-4595-a758-7fb566898302/pull/0.log" Jul 22 14:33:44.244373 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.244356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj_03b8af70-366c-4595-a758-7fb566898302/extract/0.log" Jul 22 14:33:44.361862 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.361785 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw_248c8530-de2d-4f90-abd7-a4db48316a34/util/0.log" Jul 22 14:33:44.368082 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.368060 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw_248c8530-de2d-4f90-abd7-a4db48316a34/pull/0.log" Jul 22 14:33:44.374786 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.374750 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw_248c8530-de2d-4f90-abd7-a4db48316a34/extract/0.log" Jul 22 14:33:44.503552 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.503525 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv_c66b2fa4-eb34-4f77-8c3b-a2cea1684093/util/0.log" Jul 22 14:33:44.511188 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.511138 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv_c66b2fa4-eb34-4f77-8c3b-a2cea1684093/pull/0.log" Jul 22 14:33:44.517469 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.517444 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv_c66b2fa4-eb34-4f77-8c3b-a2cea1684093/extract/0.log" Jul 22 14:33:44.645309 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.645207 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb94769cf-ffj97_5f58425c-f55c-400e-8755-83399620d5b4/authorino/0.log" Jul 22 14:33:44.891816 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:44.891785 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sq7s6_f716ed13-72f0-42c4-b859-8b406f0b4a9f/manager/0.log" Jul 22 14:33:45.126692 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:45.126647 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6tscq_5157bb87-142f-42b7-b871-3dfcf3c1a84b/registry-server/0.log" Jul 22 14:33:45.513995 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:45.513891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jt5hl_c2a4f266-84ea-417d-9378-6786caeefcda/manager/0.log" Jul 22 14:33:45.883445 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:45.883411 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hszzx_ab08f22d-4126-4123-b249-a3c340549298/istio-proxy/0.log" Jul 22 14:33:46.380773 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:46.380743 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/1.log" Jul 22 14:33:46.504222 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:46.504190 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kwhtr_eb69b457-0712-4395-b04e-a2a6e2f80c26/payload-pre-processing/0.log" Jul 22 14:33:46.631989 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:46.631898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-49nn7_ea4f483b-180a-4be4-a1d7-44222434de98/payload-processing/0.log" Jul 22 14:33:46.748316 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:46.748289 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4f55cfd4-s2c5b_05628bba-3c32-43e4-907e-f4edd8409f18/router/0.log" Jul 22 14:33:47.474234 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:47.474203 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftqg5n_489dfd58-2abf-401b-a6d5-4e8da956d91d/main/0.log" Jul 22 14:33:53.279772 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.279737 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nmppv/must-gather-sh9g4"] Jul 22 14:33:53.280168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280112 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" Jul 22 14:33:53.280168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280124 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" Jul 22 14:33:53.280168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280146 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9535349a-4cd4-4807-b373-0a6e71d06e74" containerName="test-curl-7614-140515782236176" Jul 22 14:33:53.280168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280152 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9535349a-4cd4-4807-b373-0a6e71d06e74" containerName="test-curl-7614-140515782236176" Jul 22 14:33:53.280168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280159 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" Jul 22 14:33:53.280168 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280164 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280173 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280179 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280237 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280244 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280250 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9535349a-4cd4-4807-b373-0a6e71d06e74" containerName="test-curl-7614-140515782236176" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280255 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280260 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e91f11-dfd0-4d27-94b2-2f1d95c5c8be" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280314 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" Jul 22 14:33:53.280359 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.280319 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="232fb082-0530-45cf-a429-ce3cc0a6ea12" containerName="istio-proxy" Jul 22 14:33:53.283215 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.283199 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.285291 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.285269 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmppv\"/\"kube-root-ca.crt\"" Jul 22 14:33:53.285431 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.285305 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nmppv\"/\"default-dockercfg-f2m7r\"" Jul 22 14:33:53.286104 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.286085 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmppv\"/\"openshift-service-ca.crt\"" Jul 22 14:33:53.292464 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.292440 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/must-gather-sh9g4"] Jul 22 14:33:53.294128 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.294106 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:53.380771 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.380744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgjl\" (UniqueName: \"kubernetes.io/projected/7ed7c8a2-83df-414d-863c-90700b52b21c-kube-api-access-tlgjl\") pod \"must-gather-sh9g4\" (UID: \"7ed7c8a2-83df-414d-863c-90700b52b21c\") " pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.380903 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.380809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ed7c8a2-83df-414d-863c-90700b52b21c-must-gather-output\") pod \"must-gather-sh9g4\" (UID: \"7ed7c8a2-83df-414d-863c-90700b52b21c\") " pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.394441 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.394414 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" limit=1024 Jul 22 14:33:53.482002 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.481977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgjl\" (UniqueName: \"kubernetes.io/projected/7ed7c8a2-83df-414d-863c-90700b52b21c-kube-api-access-tlgjl\") pod \"must-gather-sh9g4\" (UID: \"7ed7c8a2-83df-414d-863c-90700b52b21c\") " pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.482101 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.482042 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ed7c8a2-83df-414d-863c-90700b52b21c-must-gather-output\") pod \"must-gather-sh9g4\" (UID: \"7ed7c8a2-83df-414d-863c-90700b52b21c\") " pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.482325 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.482307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ed7c8a2-83df-414d-863c-90700b52b21c-must-gather-output\") pod \"must-gather-sh9g4\" (UID: \"7ed7c8a2-83df-414d-863c-90700b52b21c\") " pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.490492 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.490469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgjl\" (UniqueName: \"kubernetes.io/projected/7ed7c8a2-83df-414d-863c-90700b52b21c-kube-api-access-tlgjl\") pod \"must-gather-sh9g4\" (UID: \"7ed7c8a2-83df-414d-863c-90700b52b21c\") " pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.593113 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.593094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/must-gather-sh9g4" Jul 22 14:33:53.734352 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:53.734326 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/must-gather-sh9g4"] Jul 22 14:33:53.736288 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:33:53.736254 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ed7c8a2_83df_414d_863c_90700b52b21c.slice/crio-0dbfd26b23726ef95e69f95564c86bdf98a3a8a1f38f7e159f881cd3af982453 WatchSource:0}: Error finding container 0dbfd26b23726ef95e69f95564c86bdf98a3a8a1f38f7e159f881cd3af982453: Status 404 returned error can't find the container with id 0dbfd26b23726ef95e69f95564c86bdf98a3a8a1f38f7e159f881cd3af982453 Jul 22 14:33:54.533459 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:54.533425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/must-gather-sh9g4" event={"ID":"7ed7c8a2-83df-414d-863c-90700b52b21c","Type":"ContainerStarted","Data":"0dbfd26b23726ef95e69f95564c86bdf98a3a8a1f38f7e159f881cd3af982453"} Jul 22 14:33:55.544755 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:55.544713 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/must-gather-sh9g4" event={"ID":"7ed7c8a2-83df-414d-863c-90700b52b21c","Type":"ContainerStarted","Data":"87754df59d31cfa9a9b124b484126ee555dddfb7867441ba354efa97717e7cc6"} Jul 22 14:33:55.545283 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:55.544770 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/must-gather-sh9g4" event={"ID":"7ed7c8a2-83df-414d-863c-90700b52b21c","Type":"ContainerStarted","Data":"2c3fc2fcb98018a714a803a6313c4fb050f07ee61c774f584e0865abbd561c69"} Jul 22 14:33:56.281895 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:56.281851 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f8wgc_bce330f2-bfcc-4b90-ac12-e548ce40c0ba/global-pull-secret-syncer/0.log" Jul 22 14:33:56.377899 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:56.377860 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jjqgj_ddcd6349-5960-4b1f-b1df-b4e8bccf773a/konnectivity-agent/0.log" Jul 22 14:33:56.529751 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:33:56.529717 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-215.ec2.internal_d30b98ba726d66fa41d78697b204c94a/haproxy/0.log" Jul 22 14:34:01.538253 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.538167 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz_ac8826b5-834d-4ebe-93cc-70871f971825/extract/0.log" Jul 22 14:34:01.559993 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.559955 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz_ac8826b5-834d-4ebe-93cc-70871f971825/util/0.log" Jul 22 14:34:01.581103 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.581071 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gh6fz_ac8826b5-834d-4ebe-93cc-70871f971825/pull/0.log" Jul 22 14:34:01.620782 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.620743 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj_03b8af70-366c-4595-a758-7fb566898302/extract/0.log" Jul 22 14:34:01.640575 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.640545 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj_03b8af70-366c-4595-a758-7fb566898302/util/0.log" Jul 22 14:34:01.669047 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.669021 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlmj_03b8af70-366c-4595-a758-7fb566898302/pull/0.log" Jul 22 14:34:01.706410 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.706382 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw_248c8530-de2d-4f90-abd7-a4db48316a34/extract/0.log" Jul 22 14:34:01.729440 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.729414 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw_248c8530-de2d-4f90-abd7-a4db48316a34/util/0.log" Jul 22 14:34:01.749539 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.749514 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts2kw_248c8530-de2d-4f90-abd7-a4db48316a34/pull/0.log" Jul 22 14:34:01.777123 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.777089 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv_c66b2fa4-eb34-4f77-8c3b-a2cea1684093/extract/0.log" Jul 22 14:34:01.801543 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.801444 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv_c66b2fa4-eb34-4f77-8c3b-a2cea1684093/util/0.log" Jul 22 14:34:01.823654 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:01.823618 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xzvv_c66b2fa4-eb34-4f77-8c3b-a2cea1684093/pull/0.log" Jul 22 14:34:02.391050 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:02.390954 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb94769cf-ffj97_5f58425c-f55c-400e-8755-83399620d5b4/authorino/0.log" Jul 22 14:34:02.450197 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:02.450150 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-sq7s6_f716ed13-72f0-42c4-b859-8b406f0b4a9f/manager/0.log" Jul 22 14:34:02.558735 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:02.557958 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6tscq_5157bb87-142f-42b7-b871-3dfcf3c1a84b/registry-server/0.log" Jul 22 14:34:02.842745 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:02.842708 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jt5hl_c2a4f266-84ea-417d-9378-6786caeefcda/manager/0.log" Jul 22 14:34:04.549246 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:04.549201 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-w4zdg_89be1ea5-8869-470b-b2fa-99123acfac17/cluster-monitoring-operator/0.log" Jul 22 14:34:04.856647 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:04.856613 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss4hh_cca3098c-2ff7-4bf2-9b19-289bbdbf0166/node-exporter/0.log" Jul 22 14:34:04.875285 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:04.875256 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss4hh_cca3098c-2ff7-4bf2-9b19-289bbdbf0166/kube-rbac-proxy/0.log" Jul 22 14:34:04.895172 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:04.895139 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss4hh_cca3098c-2ff7-4bf2-9b19-289bbdbf0166/init-textfile/0.log" Jul 22 14:34:05.216643 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:05.216553 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cb775b649-l48lf_1a23f334-41d3-4993-b89e-0c9c35387abe/telemeter-client/0.log" Jul 22 14:34:05.237442 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:05.237391 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cb775b649-l48lf_1a23f334-41d3-4993-b89e-0c9c35387abe/reload/0.log" Jul 22 14:34:05.256178 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:05.256146 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cb775b649-l48lf_1a23f334-41d3-4993-b89e-0c9c35387abe/kube-rbac-proxy/0.log" Jul 22 14:34:06.222904 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.222825 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nmppv/must-gather-sh9g4" podStartSLOduration=12.275554025 podStartE2EDuration="13.222800337s" totalImagesPullingTime="947.246312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:33:55.561279016 +0000 UTC m=+2862.211295057" watchObservedRunningTime="2026-07-22 14:34:06.222800337 +0000 UTC m=+2872.872816378" Jul 22 14:34:06.223454 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.223431 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb"] Jul 22 14:34:06.231169 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.231141 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.237332 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.237301 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb"] Jul 22 14:34:06.348278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.347860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-proc\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.348278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.347924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gstj9\" (UniqueName: \"kubernetes.io/projected/eb6d865b-5848-4ae8-9807-483131cbe9b5-kube-api-access-gstj9\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.348278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.347985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-sys\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.348278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.348093 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-podres\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.348278 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.348126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-lib-modules\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449111 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-podres\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449111 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-lib-modules\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-proc\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gstj9\" (UniqueName: \"kubernetes.io/projected/eb6d865b-5848-4ae8-9807-483131cbe9b5-kube-api-access-gstj9\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-sys\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449272 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-lib-modules\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449272 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-podres\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449369 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449324 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-sys\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.449687 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.449408 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb6d865b-5848-4ae8-9807-483131cbe9b5-proc\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.457781 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.457749 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gstj9\" (UniqueName: \"kubernetes.io/projected/eb6d865b-5848-4ae8-9807-483131cbe9b5-kube-api-access-gstj9\") pod \"perf-node-gather-daemonset-48wlb\" (UID: \"eb6d865b-5848-4ae8-9807-483131cbe9b5\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.548381 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.548277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:06.579809 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.579749 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-279dc_67b45d8b-2f40-44ec-89dc-340c7789aa24/networking-console-plugin/0.log" Jul 22 14:34:06.761403 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:06.761311 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb"] Jul 22 14:34:06.764149 ip-10-0-140-215 kubenswrapper[2556]: W0722 14:34:06.764103 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeb6d865b_5848_4ae8_9807_483131cbe9b5.slice/crio-0a11e968a61bb082039db2c7a358f16b34d192983ebe98fd769bcb09f78453c7 WatchSource:0}: Error finding container 0a11e968a61bb082039db2c7a358f16b34d192983ebe98fd769bcb09f78453c7: Status 404 returned error can't find the container with id 0a11e968a61bb082039db2c7a358f16b34d192983ebe98fd769bcb09f78453c7 Jul 22 14:34:07.228419 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:07.228379 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/1.log" Jul 22 14:34:07.237880 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:07.237854 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w52s6_27834fe5-3551-41aa-ac25-232842ea5c5d/console-operator/2.log" Jul 22 14:34:07.652407 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:07.652354 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" event={"ID":"eb6d865b-5848-4ae8-9807-483131cbe9b5","Type":"ContainerStarted","Data":"53bc3b360d66a3c1193e40a175b54b9b3bd5cd674cee47b22c2a819bd3d3a11d"} Jul 22 14:34:07.652594 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:07.652433 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" event={"ID":"eb6d865b-5848-4ae8-9807-483131cbe9b5","Type":"ContainerStarted","Data":"0a11e968a61bb082039db2c7a358f16b34d192983ebe98fd769bcb09f78453c7"} Jul 22 14:34:07.653253 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:07.653221 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:07.670484 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:07.670433 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" podStartSLOduration=1.670417212 podStartE2EDuration="1.670417212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 14:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:34:07.668559371 +0000 UTC m=+2874.318575439" watchObservedRunningTime="2026-07-22 14:34:07.670417212 +0000 UTC m=+2874.320433254" Jul 22 14:34:08.330864 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:08.330824 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-ctbz8_1f512068-94a8-4444-a270-fdd07bf20b9f/volume-data-source-validator/0.log" Jul 22 14:34:09.367054 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:09.367017 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bjxbr_815af2ec-bb4e-420a-8d20-4606191d093b/dns/0.log" Jul 22 14:34:09.389289 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:09.389259 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bjxbr_815af2ec-bb4e-420a-8d20-4606191d093b/kube-rbac-proxy/0.log" Jul 22 14:34:09.504968 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:09.504937 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dwm5b_14e7623c-8bd6-4052-8c88-4c1e606c862a/dns-node-resolver/0.log" Jul 22 14:34:10.069353 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:10.069317 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7vhjw_f83143e8-413e-4061-b544-0e23aa8d7808/node-ca/0.log" Jul 22 14:34:11.051629 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:11.051601 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hszzx_ab08f22d-4126-4123-b249-a3c340549298/istio-proxy/0.log" Jul 22 14:34:11.305465 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:11.305381 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/0.log" Jul 22 14:34:11.362841 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:11.362794 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/1.log" Jul 22 14:34:11.404050 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:11.404017 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kwhtr_eb69b457-0712-4395-b04e-a2a6e2f80c26/payload-pre-processing/0.log" Jul 22 14:34:11.444569 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:11.444532 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-49nn7_ea4f483b-180a-4be4-a1d7-44222434de98/payload-processing/0.log" Jul 22 14:34:11.467980 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:11.467954 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4f55cfd4-s2c5b_05628bba-3c32-43e4-907e-f4edd8409f18/router/0.log" Jul 22 14:34:12.143966 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:12.143928 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5gk7m_89c84897-b70f-4cda-a30c-4e2ca5393723/serve-healthcheck-canary/0.log" Jul 22 14:34:12.668064 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:12.668033 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-f6z4g_7eac1bf2-f413-4b2f-bf4e-e3018de6fa12/insights-operator/0.log" Jul 22 14:34:12.669555 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:12.669524 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-f6z4g_7eac1bf2-f413-4b2f-bf4e-e3018de6fa12/insights-operator/1.log" Jul 22 14:34:12.824927 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:12.824879 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6mgz_3d8e35d8-b08e-4fbb-b285-cc438bf99b60/kube-rbac-proxy/0.log" Jul 22 14:34:12.844557 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:12.844528 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6mgz_3d8e35d8-b08e-4fbb-b285-cc438bf99b60/exporter/0.log" Jul 22 14:34:12.863713 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:12.863684 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6mgz_3d8e35d8-b08e-4fbb-b285-cc438bf99b60/extractor/0.log" Jul 22 14:34:14.678112 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:14.678076 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-48wlb" Jul 22 14:34:15.412094 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:15.412057 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-lnlft_707d278c-4c71-49c7-b241-8f17a25bd042/manager/0.log" Jul 22 14:34:15.432059 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:15.432026 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-lnlft_707d278c-4c71-49c7-b241-8f17a25bd042/copy-manifests/0.log" Jul 22 14:34:16.603759 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.603667 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hszzx_ab08f22d-4126-4123-b249-a3c340549298/istio-proxy/0.log" Jul 22 14:34:16.780256 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.780217 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/0.log" Jul 22 14:34:16.826363 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.826331 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/1.log" Jul 22 14:34:16.861540 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.861450 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kwhtr_eb69b457-0712-4395-b04e-a2a6e2f80c26/payload-pre-processing/0.log" Jul 22 14:34:16.895622 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.895589 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-49nn7_ea4f483b-180a-4be4-a1d7-44222434de98/payload-processing/0.log" Jul 22 14:34:16.903923 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.903881 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85c77b7bd5-nmtlk_53bef0f0-865e-4761-9074-1b1a14479e32/manager/0.log" Jul 22 14:34:16.909052 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.909004 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4f55cfd4-s2c5b_05628bba-3c32-43e4-907e-f4edd8409f18/router/0.log" Jul 22 14:34:16.934939 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:16.934085 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ll8m8_2c272a24-9706-482b-a8b3-433e2e8c2c36/openshift-lws-operator/0.log" Jul 22 14:34:18.160537 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:18.160498 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hszzx_ab08f22d-4126-4123-b249-a3c340549298/istio-proxy/0.log" Jul 22 14:34:18.342011 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:18.341974 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/0.log" Jul 22 14:34:18.392575 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:18.392543 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-j5mv2_5a6de980-514b-4488-8540-18c71b07c46d/istio-proxy/1.log" Jul 22 14:34:18.426507 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:18.426418 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kwhtr_eb69b457-0712-4395-b04e-a2a6e2f80c26/payload-pre-processing/0.log" Jul 22 14:34:18.457448 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:18.457418 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-49nn7_ea4f483b-180a-4be4-a1d7-44222434de98/payload-processing/0.log" Jul 22 14:34:18.472530 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:18.472489 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4f55cfd4-s2c5b_05628bba-3c32-43e4-907e-f4edd8409f18/router/0.log" Jul 22 14:34:22.343507 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:22.343460 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-rg9gh_8ad905e1-ae67-4923-a0bc-9b22b5719667/kube-storage-version-migrator-operator/1.log" Jul 22 14:34:22.345303 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:22.345278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-rg9gh_8ad905e1-ae67-4923-a0bc-9b22b5719667/kube-storage-version-migrator-operator/0.log" Jul 22 14:34:23.391554 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.391529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/kube-multus-additional-cni-plugins/0.log" Jul 22 14:34:23.410966 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.410937 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/egress-router-binary-copy/0.log" Jul 22 14:34:23.430689 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.430655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/cni-plugins/0.log" Jul 22 14:34:23.449641 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.449618 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/bond-cni-plugin/0.log" Jul 22 14:34:23.468666 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.468639 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/routeoverride-cni/0.log" Jul 22 14:34:23.488017 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.487990 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/whereabouts-cni-bincopy/0.log" Jul 22 14:34:23.506948 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.506896 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-54q87_45174043-1a3f-46e7-855d-c9690346a898/whereabouts-cni/0.log" Jul 22 14:34:23.851821 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.851791 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gslpg_cecee1d6-f233-482a-91ee-357f4dd3feaa/kube-multus/0.log" Jul 22 14:34:23.909545 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.909508 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nwtfn_ccdb417f-ddd0-4369-82a7-ce3ac406a7ae/network-metrics-daemon/0.log" Jul 22 14:34:23.925550 ip-10-0-140-215 kubenswrapper[2556]: I0722 14:34:23.925525 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nwtfn_ccdb417f-ddd0-4369-82a7-ce3ac406a7ae/kube-rbac-proxy/0.log"