Jul 06 19:25:10.004666 ip-10-0-128-19 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:25:11.556583 ip-10-0-128-19 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:25:11.556583 ip-10-0-128-19 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:25:11.556583 ip-10-0-128-19 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:25:11.556583 ip-10-0-128-19 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:25:11.556583 ip-10-0-128-19 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:25:11.557654 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.557546 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:25:11.562964 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562947 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:11.562964 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562963 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:11.562964 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562967 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562970 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562975 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562979 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562982 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562985 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562988 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562991 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562995 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.562997 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563006 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563009 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563012 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563015 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563018 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563021 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563024 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563027 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563030 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563033 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:11.563065 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563036 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563039 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563041 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563044 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563048 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563051 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563053 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563056 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563060 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563064 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563068 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563071 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563074 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563077 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563080 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563083 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563087 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563090 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563092 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:11.563753 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563095 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563098 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563100 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563103 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563150 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563191 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563196 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563200 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563205 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563210 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563215 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563219 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563222 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563227 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563231 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563236 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563240 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563248 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563251 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:11.564426 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563255 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:11.564933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563258 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:11.564933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563263 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:11.564933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563268 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:11.564933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563273 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:11.564933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563281 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:11.564933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.563286 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:11.565187 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565101 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:11.565300 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565289 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:11.565300 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565297 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:11.565300 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565301 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565307 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565312 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565315 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565319 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565322 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565325 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565328 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565332 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565335 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565338 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565341 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565344 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565347 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565350 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565353 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565356 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565358 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565361 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565364 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:11.565423 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565367 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565370 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565372 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565375 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565379 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565381 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565384 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565387 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:11.565955 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.565390 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:11.566174 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566161 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:11.566174 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566173 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566176 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566180 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566183 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566186 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566189 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566192 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566195 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566197 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566200 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566203 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566206 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566208 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566211 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566214 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566216 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566219 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566222 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566224 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566227 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:11.566232 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566230 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566233 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566236 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566240 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566243 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566246 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566249 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566252 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566254 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566257 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566260 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566263 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566266 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566268 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566271 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566274 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566277 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566280 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566291 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566294 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:11.566786 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566300 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566305 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566308 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566311 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566315 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566319 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566323 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566326 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566329 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566332 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566335 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566338 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566340 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566343 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566347 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566350 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566353 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566356 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566359 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:11.567334 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566362 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566364 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566368 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566371 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566374 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566377 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566380 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566382 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566385 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566388 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566390 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566393 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566395 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566398 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566401 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566403 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566406 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566408 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566411 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566413 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:11.567838 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566417 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566420 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566422 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566425 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566428 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566431 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566434 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566440 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566444 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566447 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566450 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566453 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566456 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566458 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566461 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566465 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566489 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566492 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566495 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:11.568347 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566901 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566906 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566909 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566912 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566915 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566919 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566922 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566926 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566929 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566931 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566934 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566937 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566940 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566943 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566946 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566948 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566951 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566954 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566956 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566959 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:11.568844 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566962 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566965 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566968 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566970 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566973 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566976 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566979 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566981 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566985 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566988 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566990 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566993 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566996 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.566998 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567001 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567004 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567006 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567010 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567013 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567015 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:11.569348 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567018 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567021 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567024 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567027 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567031 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567034 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567038 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567042 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567045 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567049 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567051 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567054 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567057 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567060 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567063 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567066 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567068 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567071 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567074 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:11.569881 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567076 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567079 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567082 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567085 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567088 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567090 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567093 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567096 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567098 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567101 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567106 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567109 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567113 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567116 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567119 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567122 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567125 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567128 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567131 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:11.570369 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567134 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567136 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567139 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567142 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567144 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567147 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567150 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567152 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567155 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567158 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567161 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567163 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567166 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567169 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567171 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567175 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567178 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567181 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567184 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567187 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:11.570886 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567190 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567266 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567277 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567287 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567292 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567296 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567299 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567303 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567308 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567312 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567315 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567319 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567323 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567326 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567329 2555 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567332 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567336 2555 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567339 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567342 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567347 2555 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567351 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567354 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567357 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567361 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:25:11.571456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567364 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567368 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567371 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567375 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567378 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567381 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567385 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567388 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567391 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567396 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567399 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567403 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567406 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567409 2555 flags.go:64] FLAG: --enable-server="true" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567412 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567416 2555 flags.go:64] FLAG: --event-burst="100" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567419 2555 flags.go:64] FLAG: --event-qps="50" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567422 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567426 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567429 2555 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567433 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567437 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567440 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567443 2555 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567446 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:25:11.572100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567449 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567453 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567455 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567459 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567475 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567479 2555 flags.go:64] FLAG: --feature-gates="" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567483 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567486 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567489 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567492 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567496 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567499 2555 flags.go:64] FLAG: --help="false" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567502 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-128-19.ec2.internal" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567506 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567509 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567512 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567516 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567520 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567523 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567526 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567529 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567533 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567536 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567539 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:25:11.572813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567542 2555 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567548 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567551 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567554 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567557 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567560 2555 flags.go:64] FLAG: --lock-file="" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567564 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567567 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567570 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567576 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567579 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567582 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567585 2555 flags.go:64] FLAG: --logging-format="text" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567588 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567592 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567595 2555 flags.go:64] FLAG: --manifest-url="" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567597 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567602 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567605 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567609 2555 flags.go:64] FLAG: --max-pods="110" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567612 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567615 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567619 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567622 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567625 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:25:11.573439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567628 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567631 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567638 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567641 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567644 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567648 2555 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567651 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567657 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567660 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567665 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567668 2555 flags.go:64] FLAG: --port="10250" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567671 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567674 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a18da22b7b059173" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567678 2555 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567682 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567685 2555 flags.go:64] FLAG: --register-node="true" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567688 2555 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567692 2555 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567695 2555 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567698 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567701 2555 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567705 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567708 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567711 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567714 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:25:11.574137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567717 2555 flags.go:64] FLAG: --runonce="false" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567720 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567723 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567726 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567730 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567733 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567737 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567740 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567743 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567746 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567749 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567752 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567754 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567758 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567761 2555 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567764 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567771 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567774 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567776 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567781 2555 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567784 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567787 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567790 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567793 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567796 2555 flags.go:64] FLAG: --v="2" Jul 06 19:25:11.574798 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567801 2555 flags.go:64] FLAG: --version="false" Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567806 2555 flags.go:64] FLAG: --vmodule="" Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567810 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.567813 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567940 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567944 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567948 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567951 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567955 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567959 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567963 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567966 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567968 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567972 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567977 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567979 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567982 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567985 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567988 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567990 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:11.575440 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567993 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.567997 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568000 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568005 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568008 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568011 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568014 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568017 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568020 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568022 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568025 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568028 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568031 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568034 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568037 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568039 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568042 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568045 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568048 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:11.575975 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568051 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568054 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568057 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568059 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568062 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568065 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568067 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568073 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568076 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568078 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568081 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568084 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568086 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568089 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568092 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568094 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568098 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568101 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568104 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568107 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:11.576523 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568109 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568112 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568115 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568117 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568120 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568123 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568125 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568128 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568131 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568134 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568136 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568139 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568141 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568144 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568147 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568150 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568152 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568155 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568158 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:11.577042 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568162 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568165 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568168 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568170 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568173 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568176 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568178 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568181 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568184 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568188 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568191 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568194 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568197 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568200 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568202 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568205 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568208 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568211 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568213 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568216 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568219 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:11.577611 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568222 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568224 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568228 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.568232 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.568238 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.575702 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.575717 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.576568 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.576579 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576641 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576646 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576650 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576657 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576661 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576665 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:11.578201 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576668 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576672 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576675 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576678 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576681 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576684 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576687 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576690 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576693 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576696 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576699 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576702 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576704 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576707 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576710 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576713 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576716 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576719 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576721 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:11.578602 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576724 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576727 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576730 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576733 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576737 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576740 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576742 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576745 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576748 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576751 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576754 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576757 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576760 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576763 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576766 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576768 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576771 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576774 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576777 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576779 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:11.579080 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576782 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576785 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576787 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576790 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576793 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576795 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576798 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576803 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576807 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576811 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576815 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576818 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576821 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576824 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576827 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576830 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576834 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576837 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576840 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576843 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:11.579613 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576846 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576849 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576852 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576855 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576859 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576862 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576865 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576868 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576871 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576875 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576878 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576881 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576884 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576887 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576889 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576894 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576897 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576900 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576903 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:11.580131 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576906 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576909 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576911 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576914 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576917 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576920 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576922 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576925 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576928 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576931 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576934 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576937 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576940 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576943 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.576946 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:11.580673 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.576951 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577072 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577077 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577080 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577083 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577086 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577089 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577093 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577096 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577098 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577101 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577104 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577107 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577110 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577113 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577115 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577120 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577124 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577127 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577129 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:11.581087 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577132 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577135 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577137 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577140 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577143 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577146 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577149 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577152 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577155 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577158 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577160 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577163 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577166 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577169 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577171 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577176 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577180 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577183 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577186 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:11.581722 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577189 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577192 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577195 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577198 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577201 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577204 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577207 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577210 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577213 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577216 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577219 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577221 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577224 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577227 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577229 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577232 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577235 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577237 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577240 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577243 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:11.582246 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577246 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577248 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577251 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577254 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577257 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577260 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577262 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577265 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577267 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577270 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577273 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577276 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577279 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577282 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577285 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577287 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577290 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577292 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577295 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577298 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:11.582884 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577301 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577303 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577306 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577308 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577311 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577314 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577316 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577319 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577322 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577325 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577329 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577332 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577336 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577339 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577342 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577345 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577348 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577351 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577354 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:11.583505 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577357 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:11.577359 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.577365 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.577485 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.580458 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.582086 2555 server.go:1019] "Starting client certificate rotation" Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.582209 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:25:11.584025 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.582253 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:25:11.584908 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.584893 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:25:11.588396 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.588375 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:25:11.596187 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.596170 2555 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:25:11.598367 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.598344 2555 log.go:25] "Validated CRI v1 image API" Jul 06 19:25:11.600013 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.599997 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:25:11.602704 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.602682 2555 fs.go:135] Filesystem UUIDs: map[6162ac54-f74e-4d45-966e-4eb05400bcce:/dev/nvme0n1p4 75a0e9f8-9471-4a3a-a12b-ca5f81b2cafe:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 19:25:11.602804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.602702 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:25:11.608506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.608373 2555 manager.go:216] Machine: {Timestamp:2026-07-06 19:25:11.606902275 +0000 UTC m=+1.485040997 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100952 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fd6ccb1c77559605d9cf968645abf SystemUUID:ec2fd6cc-b1c7-7559-605d-9cf968645abf BootID:c8b10e00-8b63-4c2a-b338-ef36f3b4169f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:e5:c6:32:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:e5:c6:32:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:8e:e3:f8:45:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:25:11.608506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.608494 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:25:11.608627 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.608602 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:25:11.611791 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.611767 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:25:11.611928 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.611794 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-19.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:25:11.612503 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.612492 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:25:11.612537 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.612507 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:25:11.612537 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.612515 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:25:11.613246 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.613233 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:25:11.614837 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.614824 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:25:11.617810 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.617797 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:25:11.617934 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.617924 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:25:11.618668 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.618658 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:25:11.618732 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.618680 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:25:11.618732 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.618698 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:25:11.618732 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.618707 2555 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:25:11.618732 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.618715 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:25:11.619101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.619082 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:25:11.619177 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.619114 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:25:11.621142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.621125 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:25:11.622330 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.622310 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:25:11.623072 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.623058 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:25:11.623123 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.623089 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625477 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625505 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625515 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625525 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625539 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625556 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625568 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625577 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625588 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625597 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625610 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:25:11.625688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.625620 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:25:11.626604 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.626585 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:25:11.626669 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.626612 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:25:11.630788 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.630758 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:25:11.630855 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.630788 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:25:11.630902 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.630891 2555 server.go:1268] "Started kubelet" Jul 06 19:25:11.630945 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.630899 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-19.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:25:11.631027 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.630971 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:25:11.631137 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.631045 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:25:11.631349 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.631334 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:25:11.631781 ip-10-0-128-19 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:25:11.633338 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.633325 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:25:11.633622 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.633603 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:25:11.636730 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.636711 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:25:11.637899 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.636971 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-19.ec2.internal.18bfc9d9134c4275 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-19.ec2.internal,UID:ip-10-0-128-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-19.ec2.internal,},FirstTimestamp:2026-07-06 19:25:11.630856821 +0000 UTC m=+1.508995547,LastTimestamp:2026-07-06 19:25:11.630856821 +0000 UTC m=+1.508995547,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-19.ec2.internal,}" Jul 06 19:25:11.639484 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.639448 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:25:11.639484 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.639465 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:25:11.639696 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.639609 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:11.640068 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640048 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:25:11.640068 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640070 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:25:11.640220 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640047 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:25:11.640273 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640232 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:25:11.640273 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640244 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:25:11.640372 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640296 2555 factory.go:55] Registering systemd factory Jul 06 19:25:11.640372 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640310 2555 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:25:11.640539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640523 2555 factory.go:153] Registering CRI-O factory Jul 06 19:25:11.640602 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640542 2555 factory.go:223] Registration of the crio container factory successfully Jul 06 19:25:11.640602 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640591 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:25:11.640708 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640617 2555 factory.go:103] Registering Raw factory Jul 06 19:25:11.640708 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.640633 2555 manager.go:1196] Started watching for new ooms in manager Jul 06 19:25:11.641071 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.641057 2555 manager.go:349] Starting recovery of all containers Jul 06 19:25:11.645023 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.644886 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:25:11.645023 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.644980 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:25:11.650003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.649952 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:25:11.654531 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.654306 2555 manager.go:354] Recovery completed Jul 06 19:25:11.656211 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.656186 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sjzpv" Jul 06 19:25:11.659723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.659710 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.662411 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.662376 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.662500 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.662421 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.662500 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.662443 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.663015 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.662997 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:25:11.663064 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.663015 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:25:11.663064 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.663034 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:25:11.663129 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.663008 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.664270 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.664256 2555 policy_none.go:49] "None policy: Start" Jul 06 19:25:11.664327 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.664275 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:25:11.664327 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.664289 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:25:11.664930 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.664847 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-19.ec2.internal.18bfc9d9152d7637 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-19.ec2.internal,UID:ip-10-0-128-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-19.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-19.ec2.internal,},FirstTimestamp:2026-07-06 19:25:11.662392887 +0000 UTC m=+1.540531609,LastTimestamp:2026-07-06 19:25:11.662392887 +0000 UTC m=+1.540531609,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-19.ec2.internal,}" Jul 06 19:25:11.665016 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.664997 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.665079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.665027 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.665079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.665041 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.665745 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.665733 2555 policy_none.go:47] "Start" Jul 06 19:25:11.670719 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.670698 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sjzpv" Jul 06 19:25:11.699141 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699019 2555 manager.go:337] "Starting Device Plugin manager" Jul 06 19:25:11.699235 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.699171 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:25:11.699235 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699182 2555 server.go:87] "Starting device plugin registration server" Jul 06 19:25:11.699434 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699421 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:25:11.699493 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699463 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:25:11.699586 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699561 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:25:11.699680 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699649 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:25:11.699680 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.699658 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:25:11.700117 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.700100 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:25:11.700205 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.700142 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:11.803147 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.803116 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.804123 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.804099 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.804203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.804139 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.804203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.804155 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.804203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.804190 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-19.ec2.internal" Jul 06 19:25:11.816372 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.816354 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-19.ec2.internal" Jul 06 19:25:11.816444 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.816377 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-19.ec2.internal\": node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:11.832135 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.832114 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:11.844034 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.844015 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:25:11.844100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.844056 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:25:11.844100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.844080 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:25:11.844214 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.844110 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:25:11.846998 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.846980 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:11.933258 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.933230 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:11.944324 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.944287 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"] Jul 06 19:25:11.944412 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.944368 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.946029 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.946006 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.946135 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.946036 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.946135 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.946047 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.947309 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.947294 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.947448 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.947433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:11.947520 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.947465 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.948018 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.947999 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.948101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.948034 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.948101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.948050 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.948101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.948067 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.948101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.948085 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.948101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.948095 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.949385 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.949368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" Jul 06 19:25:11.949486 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.949424 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:11.950118 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.950105 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:11.950186 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.950130 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:11.950186 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:11.950140 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:11.978134 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.978109 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-19.ec2.internal\" not found" node="ip-10-0-128-19.ec2.internal" Jul 06 19:25:11.982832 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:11.982815 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-19.ec2.internal\" not found" node="ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.034219 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.034198 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:12.042910 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.042891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7addb976effb78b7c2f501673b0975d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"7addb976effb78b7c2f501673b0975d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.042985 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.042918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ae242e03cf6765010935336af94f6ac-config\") pod \"kube-apiserver-proxy-ip-10-0-128-19.ec2.internal\" (UID: \"4ae242e03cf6765010935336af94f6ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.042985 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.042937 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7addb976effb78b7c2f501673b0975d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"7addb976effb78b7c2f501673b0975d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.134652 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.134585 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:12.143610 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.143591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7addb976effb78b7c2f501673b0975d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"7addb976effb78b7c2f501673b0975d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.143683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.143618 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7addb976effb78b7c2f501673b0975d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"7addb976effb78b7c2f501673b0975d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.143683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.143637 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ae242e03cf6765010935336af94f6ac-config\") pod \"kube-apiserver-proxy-ip-10-0-128-19.ec2.internal\" (UID: \"4ae242e03cf6765010935336af94f6ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.143683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.143666 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ae242e03cf6765010935336af94f6ac-config\") pod \"kube-apiserver-proxy-ip-10-0-128-19.ec2.internal\" (UID: \"4ae242e03cf6765010935336af94f6ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.143796 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.143706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7addb976effb78b7c2f501673b0975d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"7addb976effb78b7c2f501673b0975d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.143796 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.143706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7addb976effb78b7c2f501673b0975d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"7addb976effb78b7c2f501673b0975d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.240088 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.240060 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:12.283382 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.283345 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.285561 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.285546 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.340616 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.340586 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:12.444695 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.444626 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found" Jul 06 19:25:12.523110 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.523079 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:12.540127 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.540099 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.554585 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.554563 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:25:12.556935 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.556919 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" Jul 06 19:25:12.564237 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.564222 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:25:12.581717 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.581683 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:25:12.581858 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.581839 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:25:12.581915 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.581870 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:25:12.620700 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.620677 2555 apiserver.go:52] "Watching apiserver" Jul 06 19:25:12.639606 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.639566 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:25:12.645018 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.644995 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:25:12.645396 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.645373 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck","openshift-cluster-node-tuning-operator/tuned-5zbc2","openshift-dns/node-resolver-ng2kv","openshift-image-registry/node-ca-6tgsn","openshift-multus/multus-qb267","openshift-network-diagnostics/network-check-target-th9jz","kube-system/konnectivity-agent-llprb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal","openshift-multus/multus-additional-cni-plugins-jww5r","openshift-multus/network-metrics-daemon-lp9vz","openshift-network-operator/iptables-alerter-7xd56","openshift-ovn-kubernetes/ovnkube-node-8pslp","kube-system/global-pull-secret-syncer-scm9g"] Jul 06 19:25:12.646934 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.646915 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:12.647051 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.646989 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:12.648127 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.648109 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.649643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.649624 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.650267 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.650250 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:25:12.650426 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.650410 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:25:12.650530 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.650488 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.650594 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.650572 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.650705 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.650691 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:25:12.651191 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.651178 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.651560 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.651536 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gjwv8\"" Jul 06 19:25:12.651799 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.651783 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:25:12.651926 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.651909 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.651926 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.651918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7g9w\"" Jul 06 19:25:12.652010 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.651925 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.652379 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.652360 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.653618 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.653598 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.653724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.653636 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89757\"" Jul 06 19:25:12.653788 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.653769 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qb267" Jul 06 19:25:12.654328 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.654310 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.654620 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.654605 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.654788 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.654772 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:25:12.654937 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.654906 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.655023 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.654976 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xg6kd\"" Jul 06 19:25:12.655244 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.655221 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.655321 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.655297 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:12.655967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.655853 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:25:12.656129 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.656113 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.656471 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.656457 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.657247 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.657230 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:25:12.657316 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.657304 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.657449 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.657436 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9ssp8\"" Jul 06 19:25:12.657854 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.657840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.658549 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.658532 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lwhnc\"" Jul 06 19:25:12.658764 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.658749 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.658977 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.658953 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.659113 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.659093 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:25:12.659432 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.659408 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:12.659499 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.659477 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:12.659752 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.659736 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:25:12.659973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.659959 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7rfxj\"" Jul 06 19:25:12.660188 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.660172 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:25:12.660764 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.660746 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.662042 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.662021 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.662776 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.662758 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:12.663038 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.663022 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8qqm\"" Jul 06 19:25:12.663097 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.663045 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:12.663299 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.663253 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:25:12.664563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.664297 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:25:12.664563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.664300 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fc8qn\"" Jul 06 19:25:12.664563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.664473 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:25:12.673520 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.673473 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:20:12 +0000 UTC" deadline="2028-01-01 19:43:03.279908414 +0000 UTC" Jul 06 19:25:12.673520 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.673514 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13056h17m50.606397528s" Jul 06 19:25:12.680920 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.680902 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:25:12.741591 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.741571 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:25:12.747222 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:12.747305 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlcj\" (UniqueName: \"kubernetes.io/projected/225c145e-c964-433d-afbc-8183067672bc-kube-api-access-7qlcj\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.747305 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-var-lib-kubelet\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.747305 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c-konnectivity-ca\") pod \"konnectivity-agent-llprb\" (UID: \"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c\") " pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.747305 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-log-socket\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-cni-bin\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747370 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-os-release\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32b13207-8345-4015-8391-41ecddb10b13-multus-daemon-config\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747438 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-socket-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-systemd-units\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-cni-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-socket-dir-parent\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747511 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-netns\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-cni-multus\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747560 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cni-binary-copy\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-slash\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747592 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-systemd\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747607 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-host\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747623 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdj2n\" (UniqueName: \"kubernetes.io/projected/42b4c917-483d-42f5-be7d-6d50ad36a7b7-kube-api-access-pdj2n\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-systemd\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-run\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747669 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-kubelet\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-system-cni-dir\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.747779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-hosts-file\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-sys\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-lib-modules\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-tmp\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-system-cni-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-k8s-cni-cncf-io\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqp6\" (UniqueName: \"kubernetes.io/projected/32b13207-8345-4015-8391-41ecddb10b13-kube-api-access-hmqp6\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.747997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-kubelet\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-etc-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-kubernetes\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748076 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysctl-d\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748099 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysctl-conf\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c6rg\" (UniqueName: \"kubernetes.io/projected/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-kube-api-access-6c6rg\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f3db58d-c59e-42a7-a906-a37a70fff592-dbus\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748176 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vd4\" (UniqueName: \"kubernetes.io/projected/e0355d13-7209-4f4c-95d4-81a9d43b515d-kube-api-access-z8vd4\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.748441 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-var-lib-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-node-log\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysconfig\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-multus-certs\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0355d13-7209-4f4c-95d4-81a9d43b515d-serviceca\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-cni-bin\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748453 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovnkube-config\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpksl\" (UniqueName: \"kubernetes.io/projected/d1b78bc4-9e7f-40af-b0e4-7485411920da-kube-api-access-dpksl\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-device-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/225c145e-c964-433d-afbc-8183067672bc-iptables-alerter-script\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748632 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-run-netns\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovnkube-script-lib\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748717 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-tuned\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-etc-selinux\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-cni-netd\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-cnibin\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32b13207-8345-4015-8391-41ecddb10b13-cni-binary-copy\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-etc-kubernetes\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748871 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f3db58d-c59e-42a7-a906-a37a70fff592-kubelet-config\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748925 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xkfk\" (UniqueName: \"kubernetes.io/projected/7cf78ff9-0746-4a3a-8150-50f55e52a2df-kube-api-access-6xkfk\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-env-overrides\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748980 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cnibin\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.748998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnsd8\" (UniqueName: \"kubernetes.io/projected/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-kube-api-access-rnsd8\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749022 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-registration-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749044 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/225c145e-c964-433d-afbc-8183067672bc-host-slash\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-modprobe-d\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749075 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-run-ovn-kubernetes\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.749737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749131 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovn-node-metrics-cert\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-hostroot\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c-agent-certs\") pod \"konnectivity-agent-llprb\" (UID: \"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c\") " pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-sys-fs\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-ovn\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-os-release\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-conf-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-tmp-dir\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0355d13-7209-4f4c-95d4-81a9d43b515d-host\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.750253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.749376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm77m\" (UniqueName: \"kubernetes.io/projected/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-kube-api-access-vm77m\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.752295 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.752276 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:12.787448 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.787428 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bz9z5" Jul 06 19:25:12.799840 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.799818 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bz9z5" Jul 06 19:25:12.849664 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849632 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-systemd\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.849664 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849668 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-host\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdj2n\" (UniqueName: \"kubernetes.io/projected/42b4c917-483d-42f5-be7d-6d50ad36a7b7-kube-api-access-pdj2n\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849722 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-systemd\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849733 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-systemd\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-run\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-kubelet\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849783 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-system-cni-dir\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849872 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-hosts-file\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849902 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-sys\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849913 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-run\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.849939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-systemd\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849967 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-system-cni-dir\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.849985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-hosts-file\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.850002 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-sys\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850035 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-lib-modules\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850083 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-kubelet\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850091 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-tmp\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-host\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850131 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-lib-modules\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.850159 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:13.350116984 +0000 UTC m=+3.228255710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-system-cni-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850232 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-k8s-cni-cncf-io\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-system-cni-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqp6\" (UniqueName: \"kubernetes.io/projected/32b13207-8345-4015-8391-41ecddb10b13-kube-api-access-hmqp6\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850289 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-k8s-cni-cncf-io\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:12.850573 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850331 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-kubelet\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-etc-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-kubernetes\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850390 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-kubelet\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysctl-d\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850388 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850444 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysctl-conf\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850468 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-etc-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-kubernetes\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c6rg\" (UniqueName: \"kubernetes.io/projected/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-kube-api-access-6c6rg\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850522 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f3db58d-c59e-42a7-a906-a37a70fff592-dbus\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850549 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vd4\" (UniqueName: \"kubernetes.io/projected/e0355d13-7209-4f4c-95d4-81a9d43b515d-kube-api-access-z8vd4\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-var-lib-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850595 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysctl-d\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850606 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysctl-conf\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850627 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-var-lib-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850640 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-node-log\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysconfig\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.851528 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850684 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f3db58d-c59e-42a7-a906-a37a70fff592-dbus\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850718 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-node-log\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-sysconfig\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-multus-certs\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850789 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0355d13-7209-4f4c-95d4-81a9d43b515d-serviceca\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850838 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-multus-certs\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.852339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.850896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.852829 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.852804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-cni-bin\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853017 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.852980 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-cni-bin\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853143 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.852947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.853143 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovnkube-config\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853143 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853078 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0355d13-7209-4f4c-95d4-81a9d43b515d-serviceca\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.853143 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpksl\" (UniqueName: \"kubernetes.io/projected/d1b78bc4-9e7f-40af-b0e4-7485411920da-kube-api-access-dpksl\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853143 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.853410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853181 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-device-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.853410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.852189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.853410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/225c145e-c964-433d-afbc-8183067672bc-iptables-alerter-script\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.853410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853277 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-run-netns\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853423 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.853728 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovnkube-config\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853833 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853814 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-device-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.853909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovnkube-script-lib\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.853973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-tuned\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.854086 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.853975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-etc-selinux\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.854086 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854005 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-cni-netd\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.854086 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-cnibin\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.854086 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32b13207-8345-4015-8391-41ecddb10b13-cni-binary-copy\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-etc-kubernetes\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f3db58d-c59e-42a7-a906-a37a70fff592-kubelet-config\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xkfk\" (UniqueName: \"kubernetes.io/projected/7cf78ff9-0746-4a3a-8150-50f55e52a2df-kube-api-access-6xkfk\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-env-overrides\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cnibin\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854239 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/225c145e-c964-433d-afbc-8183067672bc-iptables-alerter-script\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854255 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnsd8\" (UniqueName: \"kubernetes.io/projected/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-kube-api-access-rnsd8\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.854294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-registration-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854313 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/225c145e-c964-433d-afbc-8183067672bc-host-slash\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854337 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-cnibin\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-modprobe-d\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854391 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-run-ovn-kubernetes\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854432 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovn-node-metrics-cert\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-hostroot\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854596 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c-agent-certs\") pod \"konnectivity-agent-llprb\" (UID: \"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c\") " pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-sys-fs\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-ovn\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.854724 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-cni-netd\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854741 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-ovn\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-tmp\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-os-release\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-run-ovn-kubernetes\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854829 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-conf-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-hostroot\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-tmp-dir\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0355d13-7209-4f4c-95d4-81a9d43b515d-host\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854969 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm77m\" (UniqueName: \"kubernetes.io/projected/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-kube-api-access-vm77m\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855009 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-etc-selinux\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855017 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32b13207-8345-4015-8391-41ecddb10b13-cni-binary-copy\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855048 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlcj\" (UniqueName: \"kubernetes.io/projected/225c145e-c964-433d-afbc-8183067672bc-kube-api-access-7qlcj\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.854438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-modprobe-d\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855077 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-etc-kubernetes\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855143 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f3db58d-c59e-42a7-a906-a37a70fff592-kubelet-config\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855390 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-os-release\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.855502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855453 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-conf-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855558 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-sys-fs\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855814 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-env-overrides\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855893 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-run-netns\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.855941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-run-openvswitch\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cnibin\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856168 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0355d13-7209-4f4c-95d4-81a9d43b515d-host\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856248 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-var-lib-kubelet\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c-konnectivity-ca\") pod \"konnectivity-agent-llprb\" (UID: \"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c\") " pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856432 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-log-socket\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovnkube-script-lib\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856622 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-tmp-dir\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.856677 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:12.856876 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.856742 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:13.356716964 +0000 UTC m=+3.234855688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/225c145e-c964-433d-afbc-8183067672bc-host-slash\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.856961 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857017 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-log-socket\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857049 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-var-lib-kubelet\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-registration-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857125 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-cni-bin\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-os-release\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857207 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-cni-bin\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32b13207-8345-4015-8391-41ecddb10b13-multus-daemon-config\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cf78ff9-0746-4a3a-8150-50f55e52a2df-os-release\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-socket-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-socket-dir\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-systemd-units\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-cni-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857444 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-systemd-units\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857472 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-socket-dir-parent\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.857887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-netns\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857529 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-cni-dir\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857534 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-cni-multus\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857574 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c-konnectivity-ca\") pod \"konnectivity-agent-llprb\" (UID: \"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c\") " pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cni-binary-copy\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857592 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-multus-socket-dir-parent\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857632 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-slash\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-run-netns\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857711 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1b78bc4-9e7f-40af-b0e4-7485411920da-host-slash\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32b13207-8345-4015-8391-41ecddb10b13-multus-daemon-config\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.857771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32b13207-8345-4015-8391-41ecddb10b13-host-var-lib-cni-multus\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.858839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.858166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cf78ff9-0746-4a3a-8150-50f55e52a2df-cni-binary-copy\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.859420 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.859397 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-etc-tuned\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.859925 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.859896 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c-agent-certs\") pod \"konnectivity-agent-llprb\" (UID: \"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c\") " pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:12.860001 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.859985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1b78bc4-9e7f-40af-b0e4-7485411920da-ovn-node-metrics-cert\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.866523 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.866504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdj2n\" (UniqueName: \"kubernetes.io/projected/42b4c917-483d-42f5-be7d-6d50ad36a7b7-kube-api-access-pdj2n\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:12.868328 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.868295 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:12.868431 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.868334 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:12.868431 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.868345 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:12.868431 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:12.868387 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:13.368374651 +0000 UTC m=+3.246513359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:12.871483 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.870534 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlcj\" (UniqueName: \"kubernetes.io/projected/225c145e-c964-433d-afbc-8183067672bc-kube-api-access-7qlcj\") pod \"iptables-alerter-7xd56\" (UID: \"225c145e-c964-433d-afbc-8183067672bc\") " pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:12.871483 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.871184 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c6rg\" (UniqueName: \"kubernetes.io/projected/ebe99fa7-a4d3-4304-a143-122bb5d39ac6-kube-api-access-6c6rg\") pod \"tuned-5zbc2\" (UID: \"ebe99fa7-a4d3-4304-a143-122bb5d39ac6\") " pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:12.871483 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.871328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqp6\" (UniqueName: \"kubernetes.io/projected/32b13207-8345-4015-8391-41ecddb10b13-kube-api-access-hmqp6\") pod \"multus-qb267\" (UID: \"32b13207-8345-4015-8391-41ecddb10b13\") " pod="openshift-multus/multus-qb267" Jul 06 19:25:12.871707 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.871619 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpksl\" (UniqueName: \"kubernetes.io/projected/d1b78bc4-9e7f-40af-b0e4-7485411920da-kube-api-access-dpksl\") pod \"ovnkube-node-8pslp\" (UID: \"d1b78bc4-9e7f-40af-b0e4-7485411920da\") " pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.871912 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.871886 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xkfk\" (UniqueName: \"kubernetes.io/projected/7cf78ff9-0746-4a3a-8150-50f55e52a2df-kube-api-access-6xkfk\") pod \"multus-additional-cni-plugins-jww5r\" (UID: \"7cf78ff9-0746-4a3a-8150-50f55e52a2df\") " pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:12.872315 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.872296 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnsd8\" (UniqueName: \"kubernetes.io/projected/28b0315c-6ffe-4a9d-bf87-ff8db6646a54-kube-api-access-rnsd8\") pod \"node-resolver-ng2kv\" (UID: \"28b0315c-6ffe-4a9d-bf87-ff8db6646a54\") " pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:12.872601 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.872585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vd4\" (UniqueName: \"kubernetes.io/projected/e0355d13-7209-4f4c-95d4-81a9d43b515d-kube-api-access-z8vd4\") pod \"node-ca-6tgsn\" (UID: \"e0355d13-7209-4f4c-95d4-81a9d43b515d\") " pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:12.872743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.872728 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm77m\" (UniqueName: \"kubernetes.io/projected/dcac81a7-e16c-44ed-a0e6-a10d2cfda061-kube-api-access-vm77m\") pod \"aws-ebs-csi-driver-node-7f7ck\" (UID: \"dcac81a7-e16c-44ed-a0e6-a10d2cfda061\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:12.909728 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:12.909700 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7addb976effb78b7c2f501673b0975d6.slice/crio-16f160b6979298e8283f1e26377ea38e09d3e921f7c8dd84f19ed89028c98b28 WatchSource:0}: Error finding container 16f160b6979298e8283f1e26377ea38e09d3e921f7c8dd84f19ed89028c98b28: Status 404 returned error can't find the container with id 16f160b6979298e8283f1e26377ea38e09d3e921f7c8dd84f19ed89028c98b28 Jul 06 19:25:12.917215 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.917199 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:25:12.972285 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:12.972257 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae242e03cf6765010935336af94f6ac.slice/crio-d10a96b2677749acca74f6d79a58dd4d7577146301ab3f1685819ac283854565 WatchSource:0}: Error finding container d10a96b2677749acca74f6d79a58dd4d7577146301ab3f1685819ac283854565: Status 404 returned error can't find the container with id d10a96b2677749acca74f6d79a58dd4d7577146301ab3f1685819ac283854565 Jul 06 19:25:12.984564 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:12.984543 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:12.991934 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:12.991909 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b78bc4_9e7f_40af_b0e4_7485411920da.slice/crio-54eacd1a99b79b5b44ff21e666601fe18cfed08f4992598a2eebad307d614a52 WatchSource:0}: Error finding container 54eacd1a99b79b5b44ff21e666601fe18cfed08f4992598a2eebad307d614a52: Status 404 returned error can't find the container with id 54eacd1a99b79b5b44ff21e666601fe18cfed08f4992598a2eebad307d614a52 Jul 06 19:25:13.001933 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.001913 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" Jul 06 19:25:13.009050 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.009028 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe99fa7_a4d3_4304_a143_122bb5d39ac6.slice/crio-3c7a5f3e956f3c5ff652cb53cb9a7459c5615168518f69b6478611fb6c7d34f0 WatchSource:0}: Error finding container 3c7a5f3e956f3c5ff652cb53cb9a7459c5615168518f69b6478611fb6c7d34f0: Status 404 returned error can't find the container with id 3c7a5f3e956f3c5ff652cb53cb9a7459c5615168518f69b6478611fb6c7d34f0 Jul 06 19:25:13.020211 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.020194 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ng2kv" Jul 06 19:25:13.027774 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.027753 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b0315c_6ffe_4a9d_bf87_ff8db6646a54.slice/crio-32f39fae65a8d3310e348290a147a5535f4440a8b6669a239ee31526e6c2d19b WatchSource:0}: Error finding container 32f39fae65a8d3310e348290a147a5535f4440a8b6669a239ee31526e6c2d19b: Status 404 returned error can't find the container with id 32f39fae65a8d3310e348290a147a5535f4440a8b6669a239ee31526e6c2d19b Jul 06 19:25:13.035547 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.035530 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6tgsn" Jul 06 19:25:13.041462 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.041443 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qb267" Jul 06 19:25:13.042583 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.042563 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0355d13_7209_4f4c_95d4_81a9d43b515d.slice/crio-71360ca6a2b6dbf64a25309528d956e23c8e77376b64785c303879e71f787857 WatchSource:0}: Error finding container 71360ca6a2b6dbf64a25309528d956e23c8e77376b64785c303879e71f787857: Status 404 returned error can't find the container with id 71360ca6a2b6dbf64a25309528d956e23c8e77376b64785c303879e71f787857 Jul 06 19:25:13.050707 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.050683 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b13207_8345_4015_8391_41ecddb10b13.slice/crio-6b18e4a825fbea32d16296c4d4ecbb51c087f3729f8f451db5e8cffc44fee9e7 WatchSource:0}: Error finding container 6b18e4a825fbea32d16296c4d4ecbb51c087f3729f8f451db5e8cffc44fee9e7: Status 404 returned error can't find the container with id 6b18e4a825fbea32d16296c4d4ecbb51c087f3729f8f451db5e8cffc44fee9e7 Jul 06 19:25:13.069204 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.069177 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" Jul 06 19:25:13.073298 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.073275 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jww5r" Jul 06 19:25:13.076919 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.076895 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcac81a7_e16c_44ed_a0e6_a10d2cfda061.slice/crio-ac084f8153f272864909fba30d5421c42515c88e9c3750cfddd18c5297192cf3 WatchSource:0}: Error finding container ac084f8153f272864909fba30d5421c42515c88e9c3750cfddd18c5297192cf3: Status 404 returned error can't find the container with id ac084f8153f272864909fba30d5421c42515c88e9c3750cfddd18c5297192cf3 Jul 06 19:25:13.081072 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.081049 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf78ff9_0746_4a3a_8150_50f55e52a2df.slice/crio-a02588da9b1fdff194418cea4c3263584def257ef3f13b2934d4342c7fd7c46b WatchSource:0}: Error finding container a02588da9b1fdff194418cea4c3263584def257ef3f13b2934d4342c7fd7c46b: Status 404 returned error can't find the container with id a02588da9b1fdff194418cea4c3263584def257ef3f13b2934d4342c7fd7c46b Jul 06 19:25:13.096242 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.096217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7xd56" Jul 06 19:25:13.103249 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.103226 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:13.104068 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.104044 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225c145e_c964_433d_afbc_8183067672bc.slice/crio-c02bddff55419eb78d88ffceba41c5405624918d41d2b8e60780b17c2c180199 WatchSource:0}: Error finding container c02bddff55419eb78d88ffceba41c5405624918d41d2b8e60780b17c2c180199: Status 404 returned error can't find the container with id c02bddff55419eb78d88ffceba41c5405624918d41d2b8e60780b17c2c180199 Jul 06 19:25:13.111406 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:25:13.111382 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8a8c74_4166_4956_b9f1_eb8dcd37ff5c.slice/crio-f05db4ea719f1023a2b649c95ac480130b5af6cfccd0a27cc7e269c5a97f7437 WatchSource:0}: Error finding container f05db4ea719f1023a2b649c95ac480130b5af6cfccd0a27cc7e269c5a97f7437: Status 404 returned error can't find the container with id f05db4ea719f1023a2b649c95ac480130b5af6cfccd0a27cc7e269c5a97f7437 Jul 06 19:25:13.112983 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.112965 2555 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-llprb_kube-system(2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 06 19:25:13.113026 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.112997 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-llprb" podUID="2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c" Jul 06 19:25:13.121384 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.121367 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:13.360781 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.360700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:13.360781 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.360755 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:13.360990 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.360865 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:13.360990 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.360894 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:13.360990 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.360926 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.360908564 +0000 UTC m=+4.239047289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:13.360990 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.360955 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.360946662 +0000 UTC m=+4.239085368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:13.461712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.461672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:13.461896 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.461825 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:13.461896 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.461846 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:13.461896 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.461860 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:13.462027 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.461932 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.461912294 +0000 UTC m=+4.340051029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:13.802124 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.802025 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:13 +0000 UTC" deadline="2028-01-05 15:47:18.127059619 +0000 UTC" Jul 06 19:25:13.802124 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.802078 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13148h22m4.324986874s" Jul 06 19:25:13.847552 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.847524 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:13.847717 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.847676 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:13.848077 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.848060 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:13.848199 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.848173 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:13.879397 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.878776 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llprb" event={"ID":"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c","Type":"ContainerStarted","Data":"f05db4ea719f1023a2b649c95ac480130b5af6cfccd0a27cc7e269c5a97f7437"} Jul 06 19:25:13.882540 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:13.882442 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-llprb" podUID="2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c" Jul 06 19:25:13.888508 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.888333 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6tgsn" event={"ID":"e0355d13-7209-4f4c-95d4-81a9d43b515d","Type":"ContainerStarted","Data":"71360ca6a2b6dbf64a25309528d956e23c8e77376b64785c303879e71f787857"} Jul 06 19:25:13.909359 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.907754 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" event={"ID":"ebe99fa7-a4d3-4304-a143-122bb5d39ac6","Type":"ContainerStarted","Data":"3c7a5f3e956f3c5ff652cb53cb9a7459c5615168518f69b6478611fb6c7d34f0"} Jul 06 19:25:13.922016 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.921983 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"54eacd1a99b79b5b44ff21e666601fe18cfed08f4992598a2eebad307d614a52"} Jul 06 19:25:13.935092 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.935060 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7xd56" event={"ID":"225c145e-c964-433d-afbc-8183067672bc","Type":"ContainerStarted","Data":"c02bddff55419eb78d88ffceba41c5405624918d41d2b8e60780b17c2c180199"} Jul 06 19:25:13.955909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.955870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerStarted","Data":"a02588da9b1fdff194418cea4c3263584def257ef3f13b2934d4342c7fd7c46b"} Jul 06 19:25:13.959933 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.959904 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" event={"ID":"dcac81a7-e16c-44ed-a0e6-a10d2cfda061","Type":"ContainerStarted","Data":"ac084f8153f272864909fba30d5421c42515c88e9c3750cfddd18c5297192cf3"} Jul 06 19:25:13.962521 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.962493 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qb267" event={"ID":"32b13207-8345-4015-8391-41ecddb10b13","Type":"ContainerStarted","Data":"6b18e4a825fbea32d16296c4d4ecbb51c087f3729f8f451db5e8cffc44fee9e7"} Jul 06 19:25:13.970636 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.970603 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ng2kv" event={"ID":"28b0315c-6ffe-4a9d-bf87-ff8db6646a54","Type":"ContainerStarted","Data":"32f39fae65a8d3310e348290a147a5535f4440a8b6669a239ee31526e6c2d19b"} Jul 06 19:25:13.979253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.979227 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" event={"ID":"4ae242e03cf6765010935336af94f6ac","Type":"ContainerStarted","Data":"d10a96b2677749acca74f6d79a58dd4d7577146301ab3f1685819ac283854565"} Jul 06 19:25:13.992898 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:13.992646 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" event={"ID":"7addb976effb78b7c2f501673b0975d6","Type":"ContainerStarted","Data":"16f160b6979298e8283f1e26377ea38e09d3e921f7c8dd84f19ed89028c98b28"} Jul 06 19:25:14.056182 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.055937 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:14.368919 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.367961 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:14.368919 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.368115 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:14.368919 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.368255 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:14.368919 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.368318 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:16.368298904 +0000 UTC m=+6.246437618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:14.368919 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.368800 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:14.368919 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.368853 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:16.368835668 +0000 UTC m=+6.246974382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:14.468684 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.468643 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:14.468882 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.468839 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:14.468882 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.468860 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:14.468882 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.468874 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:14.469062 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.468938 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:16.468918321 +0000 UTC m=+6.347057033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:14.803093 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.802944 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:13 +0000 UTC" deadline="2027-12-20 10:37:22.411640062 +0000 UTC" Jul 06 19:25:14.803093 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.803009 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12759h12m7.608635107s" Jul 06 19:25:14.845166 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:14.845108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:14.845296 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:14.845245 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:15.061995 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:15.061906 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:15.847526 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:15.847448 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:15.848161 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:15.847610 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:15.848161 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:15.848010 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:15.848302 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:15.848158 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:16.385859 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:16.385816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:16.386063 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:16.385924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:16.386135 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.386068 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:16.386187 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.386135 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:20.386115489 +0000 UTC m=+10.264254223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:16.386367 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.386307 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:16.386454 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.386437 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:20.386371432 +0000 UTC m=+10.264510156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:16.487425 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:16.487352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:16.488086 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.487595 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:16.488086 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.487624 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:16.488086 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.487639 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:16.488086 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.487719 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:20.487697626 +0000 UTC m=+10.365836355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:16.844887 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:16.844804 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:16.845070 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:16.844942 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:17.844981 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:17.844809 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:17.844981 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:17.844950 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:17.845576 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:17.845110 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:17.845576 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:17.845230 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:18.844312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:18.844231 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:18.844534 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:18.844357 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:19.847796 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:19.847760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:19.848252 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:19.847907 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:19.848333 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:19.848323 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:19.848510 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:19.848450 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:20.426164 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:20.426132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:20.426344 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:20.426184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:20.426344 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.426301 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:20.426454 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.426376 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:28.426360217 +0000 UTC m=+18.304498922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:20.426454 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.426301 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:20.426454 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.426446 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:28.42643321 +0000 UTC m=+18.304571926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:20.526936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:20.526778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:20.526936 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.526941 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:20.527165 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.526962 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:20.527165 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.526974 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:20.527165 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.527033 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:28.527016979 +0000 UTC m=+18.405155684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:20.845435 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:20.845300 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:20.845585 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:20.845463 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:21.846231 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:21.846162 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:21.846740 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:21.846322 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:21.846740 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:21.846361 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:21.846740 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:21.846470 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:22.845130 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:22.844876 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:22.845130 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:22.844996 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:23.845260 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:23.845229 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:23.845752 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:23.845353 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:23.845752 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:23.845229 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:23.845752 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:23.845471 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:24.844364 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:24.844326 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:24.844558 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:24.844470 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:25.844726 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:25.844692 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:25.845193 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:25.844908 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:25.845193 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:25.845101 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:25.845304 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:25.845223 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:26.844308 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:26.844274 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:26.844492 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:26.844414 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:27.845142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:27.845102 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:27.845619 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:27.845247 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:27.845619 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:27.845298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:27.845619 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:27.845415 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:28.483896 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:28.483789 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:28.483896 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:28.483875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:28.484064 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.483961 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:28.484064 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.483995 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:28.484064 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.484032 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:44.484012932 +0000 UTC m=+34.362151654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:28.484064 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.484056 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:44.484038907 +0000 UTC m=+34.362177615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:28.585194 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:28.585146 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:28.585408 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.585347 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:28.585408 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.585378 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:28.585408 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.585405 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:28.585560 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.585471 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:44.585452276 +0000 UTC m=+34.463591016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:28.844898 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:28.844863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:28.845154 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:28.844968 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:29.844734 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:29.844702 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:29.845164 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:29.844823 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:29.845164 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:29.844847 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:29.845164 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:29.844962 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:30.844938 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:30.844906 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:30.845412 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:30.845019 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:31.847519 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:31.847451 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:31.847519 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:31.847474 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:31.848067 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:31.847562 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:31.848067 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:31.847719 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:32.844712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:32.844674 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:32.844858 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:32.844781 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:33.845064 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:33.844649 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:33.845709 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:33.845201 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:33.845709 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:33.844913 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:33.845709 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:33.845310 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:34.056142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.056114 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cf78ff9-0746-4a3a-8150-50f55e52a2df" containerID="74472198cad54e62487bd021bb5c55633941d6b04e0cd7e21ce658fe8977930a" exitCode=0 Jul 06 19:25:34.056273 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.056186 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerDied","Data":"74472198cad54e62487bd021bb5c55633941d6b04e0cd7e21ce658fe8977930a"} Jul 06 19:25:34.057633 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.057610 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" event={"ID":"dcac81a7-e16c-44ed-a0e6-a10d2cfda061","Type":"ContainerStarted","Data":"85561d8f43ac8ac99de6914ce2ab37e13de492d46f363c80c9d743518aa4cf37"} Jul 06 19:25:34.059255 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.059234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qb267" event={"ID":"32b13207-8345-4015-8391-41ecddb10b13","Type":"ContainerStarted","Data":"cfccfeecd2e3ba85b1c12ff01a83fcf3c05462cd4b4458d987d8041db6c34abb"} Jul 06 19:25:34.060677 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.060651 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ng2kv" event={"ID":"28b0315c-6ffe-4a9d-bf87-ff8db6646a54","Type":"ContainerStarted","Data":"bd312bea79e3238ccded0340c081a26086a76c95aee23f18e065d97e72e20822"} Jul 06 19:25:34.062228 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.062207 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" event={"ID":"4ae242e03cf6765010935336af94f6ac","Type":"ContainerStarted","Data":"d71d7f927e20d1f0120bd5d24aba8ebde9463fb7bcc59e0b71a3b997af6329e1"} Jul 06 19:25:34.063613 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.063594 2555 generic.go:356] "Generic (PLEG): container finished" podID="7addb976effb78b7c2f501673b0975d6" containerID="8862cb7fb4af714b95c31004a561bff39581711f1e993991c61fa203858eea5d" exitCode=0 Jul 06 19:25:34.063696 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.063664 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" event={"ID":"7addb976effb78b7c2f501673b0975d6","Type":"ContainerDied","Data":"8862cb7fb4af714b95c31004a561bff39581711f1e993991c61fa203858eea5d"} Jul 06 19:25:34.064981 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.064962 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-llprb" event={"ID":"2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c","Type":"ContainerStarted","Data":"aadd06a014ece40c793f71a158f9e3e9fb792af0a13f5b4cd886391f9b4d4bac"} Jul 06 19:25:34.066260 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.066233 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6tgsn" event={"ID":"e0355d13-7209-4f4c-95d4-81a9d43b515d","Type":"ContainerStarted","Data":"9511536dc13bb6d7f73d279a28fed6d9ece645df7f41f047cbfe6200bea2ac22"} Jul 06 19:25:34.067541 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.067524 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" event={"ID":"ebe99fa7-a4d3-4304-a143-122bb5d39ac6","Type":"ContainerStarted","Data":"4cc501ee477acc5ceacc2ad053ab047ca9ba7f06bcafe83d44ef83e1b2ff177f"} Jul 06 19:25:34.070087 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.070071 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"8d63ea93b5ad28b48866f73954104cc0dc096b73e865270fc172f3e8b42bb0f0"} Jul 06 19:25:34.070166 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.070125 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"58b47156d7f5b9ab8416db1e40d73b4dc1dbdb9343be0c8c877620c737b25764"} Jul 06 19:25:34.070166 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.070157 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"c20fbccf85ffd0344035c27d0a22e29678c36c1c690db14c6aa2676b285aec94"} Jul 06 19:25:34.070232 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.070186 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"5900aa6489826458ab2230fad157dc5a6929e1e4ea11e4678abe5951f9840566"} Jul 06 19:25:34.070232 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.070211 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"dffc7030ccd1d4fada02eb1bc66c74a0adae3c1b0b8ebb9351584fa3bb091224"} Jul 06 19:25:34.070288 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.070238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"0385c09a679679090b7e4dad0682e9b67d78b9994c82bc5b195139d5ad38782a"} Jul 06 19:25:34.100424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.100366 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qb267" podStartSLOduration=2.1155951 podStartE2EDuration="22.100354723s" totalImagesPullingTime="19.984759623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:34.10035339 +0000 UTC m=+23.978492118" watchObservedRunningTime="2026-07-06 19:25:34.100354723 +0000 UTC m=+23.978493452" Jul 06 19:25:34.125260 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.125221 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" podStartSLOduration=21.125213195 podStartE2EDuration="21.125213195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:34.124945234 +0000 UTC m=+24.003083963" watchObservedRunningTime="2026-07-06 19:25:34.125213195 +0000 UTC m=+24.003351922" Jul 06 19:25:34.142489 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.142253 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5zbc2" podStartSLOduration=2.143260291 podStartE2EDuration="22.142242742s" totalImagesPullingTime="19.998982451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:34.141983301 +0000 UTC m=+24.020122030" watchObservedRunningTime="2026-07-06 19:25:34.142242742 +0000 UTC m=+24.020381469" Jul 06 19:25:34.160429 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.160374 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-llprb" podStartSLOduration=2.107354183 podStartE2EDuration="22.160363674s" totalImagesPullingTime="20.053009491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 19:25:34.160172362 +0000 UTC m=+24.038311090" watchObservedRunningTime="2026-07-06 19:25:34.160363674 +0000 UTC m=+24.038502402" Jul 06 19:25:34.181520 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.181485 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ng2kv" podStartSLOduration=2.726241295 podStartE2EDuration="22.181474211s" totalImagesPullingTime="19.455232916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:34.181228603 +0000 UTC m=+24.059367332" watchObservedRunningTime="2026-07-06 19:25:34.181474211 +0000 UTC m=+24.059612938" Jul 06 19:25:34.202952 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.202908 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6tgsn" podStartSLOduration=7.107020576 podStartE2EDuration="22.202893516s" totalImagesPullingTime="15.09587294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:34.202354947 +0000 UTC m=+24.080493666" watchObservedRunningTime="2026-07-06 19:25:34.202893516 +0000 UTC m=+24.081032245" Jul 06 19:25:34.255647 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.255618 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:34.256296 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.256273 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:34.844704 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:34.844671 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:34.844875 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:34.844794 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:35.074547 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.074517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7xd56" event={"ID":"225c145e-c964-433d-afbc-8183067672bc","Type":"ContainerStarted","Data":"0b8589889f6e70ed7e8ca6d4902a52ed1e1d2443f8f8fe83416ebc6d0ad48d7b"} Jul 06 19:25:35.095839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.095764 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7xd56" podStartSLOduration=8.060980752 podStartE2EDuration="23.095748367s" totalImagesPullingTime="15.034767615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:35.095104705 +0000 UTC m=+24.973243433" watchObservedRunningTime="2026-07-06 19:25:35.095748367 +0000 UTC m=+24.973887095" Jul 06 19:25:35.105163 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.105140 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:25:35.717505 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.717420 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:25:35.105160829Z","UUID":"b0587082-c259-4837-9070-e263eb367a51","Handler":null,"Name":"","Endpoint":""} Jul 06 19:25:35.718984 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.718955 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:25:35.718984 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.718989 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:25:35.845261 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.845233 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:35.845261 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:35.845247 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:35.845514 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:35.845371 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:35.845770 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:35.845741 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:36.079618 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:36.079585 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" event={"ID":"7addb976effb78b7c2f501673b0975d6","Type":"ContainerStarted","Data":"22784336d8671bb4aa9370cba9d07de6530cdf874ea53bf814ac1a84433014dc"} Jul 06 19:25:36.083439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:36.083414 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"f42322ded3abc31cc5b7b55195fa985fd49c9c1a4b776b23207f7ef766076d7c"} Jul 06 19:25:36.085420 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:36.085380 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" event={"ID":"dcac81a7-e16c-44ed-a0e6-a10d2cfda061","Type":"ContainerStarted","Data":"a7799d392e74b19be66734f0730cf01e443656da526eaf4131d789f67b3fe507"} Jul 06 19:25:36.085509 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:36.085441 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:25:36.097823 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:36.097776 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" podStartSLOduration=24.097760399 podStartE2EDuration="24.097760399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:36.09744716 +0000 UTC m=+25.975585888" watchObservedRunningTime="2026-07-06 19:25:36.097760399 +0000 UTC m=+25.975899130" Jul 06 19:25:36.844440 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:36.844404 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:36.844619 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:36.844528 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:37.089477 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:37.089444 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" event={"ID":"dcac81a7-e16c-44ed-a0e6-a10d2cfda061","Type":"ContainerStarted","Data":"b949af895e8c1c0cd26bf68881311f8c3112280fcda779e67e93e2142ab8f1b5"} Jul 06 19:25:37.109346 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:37.109214 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7f7ck" podStartSLOduration=2.895463951 podStartE2EDuration="25.109193028s" totalImagesPullingTime="22.213729077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:37.108707748 +0000 UTC m=+26.986846494" watchObservedRunningTime="2026-07-06 19:25:37.109193028 +0000 UTC m=+26.987331759" Jul 06 19:25:37.844350 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:37.844323 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:37.844350 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:37.844349 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:37.844572 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:37.844467 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:37.844572 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:37.844533 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:37.896489 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:37.896468 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ng2kv_28b0315c-6ffe-4a9d-bf87-ff8db6646a54/dns-node-resolver/0.log" Jul 06 19:25:38.467870 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:38.467844 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6tgsn_e0355d13-7209-4f4c-95d4-81a9d43b515d/node-ca/0.log" Jul 06 19:25:38.844689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:38.844507 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:38.844840 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:38.844791 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:39.120943 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:39.120863 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:39.121099 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:39.121010 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:25:39.121524 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:39.121472 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-llprb" Jul 06 19:25:39.844313 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:39.844287 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:39.844768 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:39.844419 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:39.844768 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:39.844457 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:39.844768 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:39.844542 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:40.098076 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:40.098042 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerStarted","Data":"7bc05130b2436f4a3ccbb770475ea7d1909fa9b441bae65b5b43a84d650d0961"} Jul 06 19:25:40.101986 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:40.101961 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" event={"ID":"d1b78bc4-9e7f-40af-b0e4-7485411920da","Type":"ContainerStarted","Data":"dee188b7771b154395e3ee21479597f680f6af04c2964a8c405e8e7adfdf125b"} Jul 06 19:25:40.102270 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:40.102253 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:40.102374 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:40.102324 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:40.116681 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:40.116659 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:40.845084 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:40.845055 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:40.845659 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:40.845144 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:41.106011 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.105935 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cf78ff9-0746-4a3a-8150-50f55e52a2df" containerID="7bc05130b2436f4a3ccbb770475ea7d1909fa9b441bae65b5b43a84d650d0961" exitCode=0 Jul 06 19:25:41.106155 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.106023 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerDied","Data":"7bc05130b2436f4a3ccbb770475ea7d1909fa9b441bae65b5b43a84d650d0961"} Jul 06 19:25:41.106421 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.106403 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:41.121365 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.121343 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:25:41.132670 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.132634 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" podStartSLOduration=8.957718857 podStartE2EDuration="29.132620782s" totalImagesPullingTime="20.174901925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:40.156273346 +0000 UTC m=+30.034412075" watchObservedRunningTime="2026-07-06 19:25:41.132620782 +0000 UTC m=+31.010759512" Jul 06 19:25:41.845817 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.845782 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:41.846166 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:41.845921 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:41.846166 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:41.845953 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:41.846166 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:41.846041 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:42.844611 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:42.844434 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:42.844773 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:42.844693 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:43.111304 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:43.111220 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cf78ff9-0746-4a3a-8150-50f55e52a2df" containerID="b3b2258bfe216f9d0caa3cccdbe02827437e82a3aed1049e3154a2aaccd9c847" exitCode=0 Jul 06 19:25:43.111711 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:43.111304 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerDied","Data":"b3b2258bfe216f9d0caa3cccdbe02827437e82a3aed1049e3154a2aaccd9c847"} Jul 06 19:25:43.845219 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:43.845186 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:43.845362 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:43.845290 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:43.845362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:43.845342 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:43.845553 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:43.845453 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:44.507599 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:44.507556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:44.507939 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:44.507624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:44.507939 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.507708 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:44.507939 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.507724 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:44.507939 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.507771 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret podName:6f3db58d-c59e-42a7-a906-a37a70fff592 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.507758699 +0000 UTC m=+66.385897421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret") pod "global-pull-secret-syncer-scm9g" (UID: "6f3db58d-c59e-42a7-a906-a37a70fff592") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:44.507939 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.507788 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs podName:42b4c917-483d-42f5-be7d-6d50ad36a7b7 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.507781174 +0000 UTC m=+66.385919893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs") pod "network-metrics-daemon-lp9vz" (UID: "42b4c917-483d-42f5-be7d-6d50ad36a7b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:44.607979 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:44.607946 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:44.608130 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.608111 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:44.608193 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.608133 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:44.608193 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.608142 2555 projected.go:196] Error preparing data for projected volume kube-api-access-bdvwb for pod openshift-network-diagnostics/network-check-target-th9jz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:44.608193 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.608190 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb podName:1411d062-5009-48bd-b608-816f0b56fe37 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.608177067 +0000 UTC m=+66.486315773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdvwb" (UniqueName: "kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb") pod "network-check-target-th9jz" (UID: "1411d062-5009-48bd-b608-816f0b56fe37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:44.845350 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:44.845277 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:44.845498 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:44.845371 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:45.117593 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:45.117516 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cf78ff9-0746-4a3a-8150-50f55e52a2df" containerID="dc4049a3257f74500af8f093503b858ce4b9e7adf25f69e7c0412c1795105648" exitCode=0 Jul 06 19:25:45.117593 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:45.117580 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerDied","Data":"dc4049a3257f74500af8f093503b858ce4b9e7adf25f69e7c0412c1795105648"} Jul 06 19:25:45.845293 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:45.845260 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:45.845732 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:45.845406 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:45.845813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:45.845752 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:45.845881 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:45.845860 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:46.844538 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:46.844506 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:46.844721 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:46.844617 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:47.844821 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:47.844790 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:47.845169 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:47.844897 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:47.845169 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:47.844968 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:47.845169 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:47.845054 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:48.845335 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:48.845294 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:48.845728 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:48.845422 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:49.844371 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:49.844317 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:49.844499 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:49.844422 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:49.844499 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:49.844470 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:49.844577 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:49.844560 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:50.132151 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:50.132077 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cf78ff9-0746-4a3a-8150-50f55e52a2df" containerID="a9a54d4abcc669efdb51cfde910dcc3b06eb634e3cdce2a686d49e3c7a1a4654" exitCode=0 Jul 06 19:25:50.132151 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:50.132139 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerDied","Data":"a9a54d4abcc669efdb51cfde910dcc3b06eb634e3cdce2a686d49e3c7a1a4654"} Jul 06 19:25:50.844787 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:50.844755 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:50.844936 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:50.844852 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:51.140215 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:51.140141 2555 generic.go:356] "Generic (PLEG): container finished" podID="7cf78ff9-0746-4a3a-8150-50f55e52a2df" containerID="a97b702a1647c9ded3f3588dafca9ad614af8f229e0dbcabb824b4a3ecaea419" exitCode=0 Jul 06 19:25:51.140215 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:51.140185 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerDied","Data":"a97b702a1647c9ded3f3588dafca9ad614af8f229e0dbcabb824b4a3ecaea419"} Jul 06 19:25:51.845222 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:51.845186 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:51.845485 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:51.845281 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:51.845485 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:51.845330 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:51.845485 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:51.845445 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:52.145847 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:52.145774 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jww5r" event={"ID":"7cf78ff9-0746-4a3a-8150-50f55e52a2df","Type":"ContainerStarted","Data":"baedd33d4ff7c8c307367ca2ecc1ee10cbb15078afb391d553b73f1e1df1d742"} Jul 06 19:25:52.173522 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:52.173479 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jww5r" podStartSLOduration=8.17904593 podStartE2EDuration="40.17346092s" totalImagesPullingTime="31.99441499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:52.173444067 +0000 UTC m=+42.051582795" watchObservedRunningTime="2026-07-06 19:25:52.17346092 +0000 UTC m=+42.051599769" Jul 06 19:25:52.844435 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:52.844408 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:52.844593 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:52.844512 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:53.844772 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:53.844742 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:53.845200 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:53.844859 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:53.845200 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:53.844914 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:53.845200 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:53.845008 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:54.844272 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:54.844242 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:54.844459 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:54.844336 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:55.845208 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:55.845178 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:55.845208 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:55.845212 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:55.845614 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:55.845314 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:55.845614 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:55.845430 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:56.845192 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:56.845167 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:56.845345 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:56.845252 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:57.844817 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:57.844784 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:57.844957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:57.844785 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:57.844957 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:57.844901 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:25:57.845054 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:57.844964 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:58.845211 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:58.845182 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:25:58.845610 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:58.845279 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:25:59.845380 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:59.845349 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:25:59.845842 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:25:59.845415 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:25:59.845842 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:59.845508 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:25:59.845842 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:25:59.845615 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:26:00.351835 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:00.351803 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lp9vz"] Jul 06 19:26:00.351981 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:00.351910 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:00.352021 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:00.352001 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:26:00.355807 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:00.355770 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-th9jz"] Jul 06 19:26:00.355948 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:00.355884 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:00.356016 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:00.355975 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:26:00.356512 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:00.356490 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-scm9g"] Jul 06 19:26:00.356600 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:00.356575 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:00.356684 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:00.356665 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:26:01.848882 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:01.848851 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:01.849369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:01.848973 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:01.849369 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:01.849013 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:26:01.849369 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:01.849060 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:26:01.849369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:01.849085 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:01.849369 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:01.849153 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:26:03.844734 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:03.844708 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:03.844734 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:03.844734 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:03.845363 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:03.844709 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:03.845363 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:03.844807 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scm9g" podUID="6f3db58d-c59e-42a7-a906-a37a70fff592" Jul 06 19:26:03.845363 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:03.844893 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lp9vz" podUID="42b4c917-483d-42f5-be7d-6d50ad36a7b7" Jul 06 19:26:03.845363 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:26:03.844949 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th9jz" podUID="1411d062-5009-48bd-b608-816f0b56fe37" Jul 06 19:26:04.857308 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.857228 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeReady" Jul 06 19:26:04.857896 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.857345 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:26:04.904766 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.904731 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5bj66"] Jul 06 19:26:04.930870 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.930846 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d6mfx"] Jul 06 19:26:04.931011 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.930962 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:04.933173 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.933153 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khkrm\"" Jul 06 19:26:04.933333 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.933223 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:26:04.933333 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.933266 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:26:04.951008 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.950980 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bj66"] Jul 06 19:26:04.951110 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.951013 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d6mfx"] Jul 06 19:26:04.951110 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.951035 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fx9x4"] Jul 06 19:26:04.951110 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.951102 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:04.953577 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.953553 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:26:04.953690 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.953580 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:26:04.953690 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.953604 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:26:04.953690 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.953606 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vrv2c\"" Jul 06 19:26:04.959784 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.959760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed5b877-f8e2-44c6-b44c-29430df177d6-cert\") pod \"ingress-canary-d6mfx\" (UID: \"2ed5b877-f8e2-44c6-b44c-29430df177d6\") " pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:04.959905 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.959807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fde805-16ad-4992-81e6-7b95fb344fdc-metrics-tls\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:04.959905 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.959823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fde805-16ad-4992-81e6-7b95fb344fdc-tmp-dir\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:04.959905 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.959887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8z85\" (UniqueName: \"kubernetes.io/projected/2ed5b877-f8e2-44c6-b44c-29430df177d6-kube-api-access-g8z85\") pod \"ingress-canary-d6mfx\" (UID: \"2ed5b877-f8e2-44c6-b44c-29430df177d6\") " pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:04.960022 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.959911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fde805-16ad-4992-81e6-7b95fb344fdc-config-volume\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:04.960022 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.959933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4bz6\" (UniqueName: \"kubernetes.io/projected/39fde805-16ad-4992-81e6-7b95fb344fdc-kube-api-access-g4bz6\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:04.975568 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.975550 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fx9x4"] Jul 06 19:26:04.975659 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.975645 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:04.977871 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.977853 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:26:04.977976 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.977955 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:26:04.978224 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.978208 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f282m\"" Jul 06 19:26:04.978310 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.978280 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:26:04.978371 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:04.978316 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:26:05.060185 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34ae7efd-a366-40f1-8833-86fb50abc8dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.060185 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fde805-16ad-4992-81e6-7b95fb344fdc-metrics-tls\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060204 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fde805-16ad-4992-81e6-7b95fb344fdc-tmp-dir\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34ae7efd-a366-40f1-8833-86fb50abc8dc-crio-socket\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34ae7efd-a366-40f1-8833-86fb50abc8dc-data-volume\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8z85\" (UniqueName: \"kubernetes.io/projected/2ed5b877-f8e2-44c6-b44c-29430df177d6-kube-api-access-g8z85\") pod \"ingress-canary-d6mfx\" (UID: \"2ed5b877-f8e2-44c6-b44c-29430df177d6\") " pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060278 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34ae7efd-a366-40f1-8833-86fb50abc8dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fde805-16ad-4992-81e6-7b95fb344fdc-config-volume\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4bz6\" (UniqueName: \"kubernetes.io/projected/39fde805-16ad-4992-81e6-7b95fb344fdc-kube-api-access-g4bz6\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.060424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060370 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khh99\" (UniqueName: \"kubernetes.io/projected/34ae7efd-a366-40f1-8833-86fb50abc8dc-kube-api-access-khh99\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.060771 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060465 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed5b877-f8e2-44c6-b44c-29430df177d6-cert\") pod \"ingress-canary-d6mfx\" (UID: \"2ed5b877-f8e2-44c6-b44c-29430df177d6\") " pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:05.060771 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.060673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39fde805-16ad-4992-81e6-7b95fb344fdc-tmp-dir\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.061036 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.061018 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39fde805-16ad-4992-81e6-7b95fb344fdc-config-volume\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.064156 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.064134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39fde805-16ad-4992-81e6-7b95fb344fdc-metrics-tls\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.064327 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.064312 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed5b877-f8e2-44c6-b44c-29430df177d6-cert\") pod \"ingress-canary-d6mfx\" (UID: \"2ed5b877-f8e2-44c6-b44c-29430df177d6\") " pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:05.068999 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.068977 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4bz6\" (UniqueName: \"kubernetes.io/projected/39fde805-16ad-4992-81e6-7b95fb344fdc-kube-api-access-g4bz6\") pod \"dns-default-5bj66\" (UID: \"39fde805-16ad-4992-81e6-7b95fb344fdc\") " pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.069337 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.069316 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8z85\" (UniqueName: \"kubernetes.io/projected/2ed5b877-f8e2-44c6-b44c-29430df177d6-kube-api-access-g8z85\") pod \"ingress-canary-d6mfx\" (UID: \"2ed5b877-f8e2-44c6-b44c-29430df177d6\") " pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:05.161647 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.161562 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34ae7efd-a366-40f1-8833-86fb50abc8dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.161647 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.161602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34ae7efd-a366-40f1-8833-86fb50abc8dc-crio-socket\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.161647 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.161618 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34ae7efd-a366-40f1-8833-86fb50abc8dc-data-volume\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.161647 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.161637 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34ae7efd-a366-40f1-8833-86fb50abc8dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.161973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.161661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khh99\" (UniqueName: \"kubernetes.io/projected/34ae7efd-a366-40f1-8833-86fb50abc8dc-kube-api-access-khh99\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.161973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.161801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34ae7efd-a366-40f1-8833-86fb50abc8dc-crio-socket\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.162093 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.162029 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34ae7efd-a366-40f1-8833-86fb50abc8dc-data-volume\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.162093 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.162072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34ae7efd-a366-40f1-8833-86fb50abc8dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.163857 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.163830 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34ae7efd-a366-40f1-8833-86fb50abc8dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.171735 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.171710 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khh99\" (UniqueName: \"kubernetes.io/projected/34ae7efd-a366-40f1-8833-86fb50abc8dc-kube-api-access-khh99\") pod \"insights-runtime-extractor-fx9x4\" (UID: \"34ae7efd-a366-40f1-8833-86fb50abc8dc\") " pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.240265 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.240234 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:05.259480 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.259450 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d6mfx" Jul 06 19:26:05.284079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.284054 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fx9x4" Jul 06 19:26:05.427826 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.427575 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5bj66"] Jul 06 19:26:05.428015 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.427998 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d6mfx"] Jul 06 19:26:05.431125 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:05.431102 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fde805_16ad_4992_81e6_7b95fb344fdc.slice/crio-c8a773964c1dbdb149065455236bb7e07a02523ef00165c8aabd9b61d67c06be WatchSource:0}: Error finding container c8a773964c1dbdb149065455236bb7e07a02523ef00165c8aabd9b61d67c06be: Status 404 returned error can't find the container with id c8a773964c1dbdb149065455236bb7e07a02523ef00165c8aabd9b61d67c06be Jul 06 19:26:05.431927 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:05.431901 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed5b877_f8e2_44c6_b44c_29430df177d6.slice/crio-00b232d5d458ac502730f52ff8d2ff475c6c8af96ec165fceed46ac04564bee8 WatchSource:0}: Error finding container 00b232d5d458ac502730f52ff8d2ff475c6c8af96ec165fceed46ac04564bee8: Status 404 returned error can't find the container with id 00b232d5d458ac502730f52ff8d2ff475c6c8af96ec165fceed46ac04564bee8 Jul 06 19:26:05.440260 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.440236 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fx9x4"] Jul 06 19:26:05.442464 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:05.442434 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ae7efd_a366_40f1_8833_86fb50abc8dc.slice/crio-8ad9c21f98923cc821ff84f8592010731776a749e3e71e7b219e5995e49cbadc WatchSource:0}: Error finding container 8ad9c21f98923cc821ff84f8592010731776a749e3e71e7b219e5995e49cbadc: Status 404 returned error can't find the container with id 8ad9c21f98923cc821ff84f8592010731776a749e3e71e7b219e5995e49cbadc Jul 06 19:26:05.822154 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.822126 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dzb5w"] Jul 06 19:26:05.824889 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.824864 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:05.827027 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.826997 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:26:05.827159 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.827038 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pnpg8\"" Jul 06 19:26:05.827159 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.827090 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:26:05.844500 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.844476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:05.844627 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.844478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:05.844684 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.844478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:05.848248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.847486 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:26:05.848248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.847494 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:26:05.848248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.847810 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:26:05.848248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.847948 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qhtzw\"" Jul 06 19:26:05.848248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.848024 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkxjr\"" Jul 06 19:26:05.848248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.848059 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:26:05.851183 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.850104 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dzb5w"] Jul 06 19:26:05.870107 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.866917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9nd4\" (UniqueName: \"kubernetes.io/projected/d61e31f2-7446-4c93-9e54-99255dbef4d3-kube-api-access-q9nd4\") pod \"downloads-685bfb5f64-dzb5w\" (UID: \"d61e31f2-7446-4c93-9e54-99255dbef4d3\") " pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:05.967353 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:05.967315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9nd4\" (UniqueName: \"kubernetes.io/projected/d61e31f2-7446-4c93-9e54-99255dbef4d3-kube-api-access-q9nd4\") pod \"downloads-685bfb5f64-dzb5w\" (UID: \"d61e31f2-7446-4c93-9e54-99255dbef4d3\") " pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:06.006111 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:06.006076 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9nd4\" (UniqueName: \"kubernetes.io/projected/d61e31f2-7446-4c93-9e54-99255dbef4d3-kube-api-access-q9nd4\") pod \"downloads-685bfb5f64-dzb5w\" (UID: \"d61e31f2-7446-4c93-9e54-99255dbef4d3\") " pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:06.133752 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:06.133676 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:06.183007 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:06.182818 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bj66" event={"ID":"39fde805-16ad-4992-81e6-7b95fb344fdc","Type":"ContainerStarted","Data":"c8a773964c1dbdb149065455236bb7e07a02523ef00165c8aabd9b61d67c06be"} Jul 06 19:26:06.185928 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:06.185812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fx9x4" event={"ID":"34ae7efd-a366-40f1-8833-86fb50abc8dc","Type":"ContainerStarted","Data":"8ad9c21f98923cc821ff84f8592010731776a749e3e71e7b219e5995e49cbadc"} Jul 06 19:26:06.187751 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:06.187725 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d6mfx" event={"ID":"2ed5b877-f8e2-44c6-b44c-29430df177d6","Type":"ContainerStarted","Data":"00b232d5d458ac502730f52ff8d2ff475c6c8af96ec165fceed46ac04564bee8"} Jul 06 19:26:06.346604 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:06.346507 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dzb5w"] Jul 06 19:26:07.194874 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:07.194837 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dzb5w" event={"ID":"d61e31f2-7446-4c93-9e54-99255dbef4d3","Type":"ContainerStarted","Data":"5608664459f9784265032568e7bfb94d21841cc8f75dc62e96e2ea8005a788f0"} Jul 06 19:26:09.197571 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.197368 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc"] Jul 06 19:26:09.199958 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.199852 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.202369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.202322 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 19:26:09.202501 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.202376 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:26:09.203298 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.203278 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b69n8\"" Jul 06 19:26:09.203735 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.203715 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 19:26:09.203835 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.203744 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:26:09.203835 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.203790 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:26:09.216954 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.216894 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc"] Jul 06 19:26:09.299607 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.299572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.299764 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.299654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.299764 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.299719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55khj\" (UniqueName: \"kubernetes.io/projected/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-kube-api-access-55khj\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.299849 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.299777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.400918 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.400877 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.401101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.400926 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.401101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.400953 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55khj\" (UniqueName: \"kubernetes.io/projected/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-kube-api-access-55khj\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.401101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.401001 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.401856 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.401829 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.404541 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.404492 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.404642 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.404572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.411035 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.410993 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55khj\" (UniqueName: \"kubernetes.io/projected/0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb-kube-api-access-55khj\") pod \"prometheus-operator-567f7b8b7c-hzfsc\" (UID: \"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:09.512340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:09.512300 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" Jul 06 19:26:11.176247 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:11.176169 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc"] Jul 06 19:26:11.184420 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:11.183863 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc07c45_d7db_4b4b_b8d7_eb36a000b6bb.slice/crio-2275ac62938262a891337340fbe07ed2cb6392360f4d635500994b874cc01eaf WatchSource:0}: Error finding container 2275ac62938262a891337340fbe07ed2cb6392360f4d635500994b874cc01eaf: Status 404 returned error can't find the container with id 2275ac62938262a891337340fbe07ed2cb6392360f4d635500994b874cc01eaf Jul 06 19:26:11.210897 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:11.210799 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bj66" event={"ID":"39fde805-16ad-4992-81e6-7b95fb344fdc","Type":"ContainerStarted","Data":"ec9d7a6f6a7722e73e827e7d12247bf5869d4e3a691f3eaad5f2a6ce779ec0b4"} Jul 06 19:26:11.214203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:11.213521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d6mfx" event={"ID":"2ed5b877-f8e2-44c6-b44c-29430df177d6","Type":"ContainerStarted","Data":"4a2fd34e08489e2c01181e545e0a49814dba7d5facbbba2b1618dca6178cf410"} Jul 06 19:26:11.216094 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:11.216065 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" event={"ID":"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb","Type":"ContainerStarted","Data":"2275ac62938262a891337340fbe07ed2cb6392360f4d635500994b874cc01eaf"} Jul 06 19:26:11.238888 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:11.238774 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d6mfx" podStartSLOduration=1.6540575739999999 podStartE2EDuration="7.238753004s" totalImagesPullingTime="5.58469543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.238188035 +0000 UTC m=+61.116326763" watchObservedRunningTime="2026-07-06 19:26:11.238753004 +0000 UTC m=+61.116891712" Jul 06 19:26:12.220758 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:12.220710 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5bj66" event={"ID":"39fde805-16ad-4992-81e6-7b95fb344fdc","Type":"ContainerStarted","Data":"fc682f3edf47356cdac079b6e30140eddf034a4459d5551909372612f5a60a84"} Jul 06 19:26:12.221262 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:12.220819 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:12.222450 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:12.222417 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fx9x4" event={"ID":"34ae7efd-a366-40f1-8833-86fb50abc8dc","Type":"ContainerStarted","Data":"ce1a437b484148c4379b8c45a0a8e424d916f567a8f931caf047a3136a4b0300"} Jul 06 19:26:13.122910 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:13.122877 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8pslp" Jul 06 19:26:13.154987 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:13.154932 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5bj66" podStartSLOduration=3.577957515 podStartE2EDuration="9.154915465s" totalImagesPullingTime="5.57695795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:12.249480233 +0000 UTC m=+62.127618962" watchObservedRunningTime="2026-07-06 19:26:13.154915465 +0000 UTC m=+63.033054193" Jul 06 19:26:13.227249 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:13.227210 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fx9x4" event={"ID":"34ae7efd-a366-40f1-8833-86fb50abc8dc","Type":"ContainerStarted","Data":"8230668ad39f64bf98026cbb4402d41db666196a32cfd77d296f5bf368ea31d1"} Jul 06 19:26:13.229155 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:13.229112 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" event={"ID":"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb","Type":"ContainerStarted","Data":"954c3de4d37411a5897e4f6fec5dab74065513480ed2ec0b3ebcb72540a50c54"} Jul 06 19:26:13.229272 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:13.229169 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" event={"ID":"0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb","Type":"ContainerStarted","Data":"c8b633d1bb25bfaad04c53fcb4f0d5446dce05576b23f62b7c4c5105a5805f1d"} Jul 06 19:26:13.253833 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:13.253772 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-hzfsc" podStartSLOduration=2.6944086240000003 podStartE2EDuration="4.2537531s" totalImagesPullingTime="1.559344476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:13.252384508 +0000 UTC m=+63.130523263" watchObservedRunningTime="2026-07-06 19:26:13.2537531 +0000 UTC m=+63.131891830" Jul 06 19:26:16.242975 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.242933 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fx9x4" event={"ID":"34ae7efd-a366-40f1-8833-86fb50abc8dc","Type":"ContainerStarted","Data":"5e7239a877f91afd03b03bed7ef3eba59e79db9850ddae662c4516a359d1edfd"} Jul 06 19:26:16.294378 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.294320 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fx9x4" podStartSLOduration=2.409929817 podStartE2EDuration="12.294300517s" totalImagesPullingTime="9.8843707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:16.293282941 +0000 UTC m=+66.171421668" watchObservedRunningTime="2026-07-06 19:26:16.294300517 +0000 UTC m=+66.172439245" Jul 06 19:26:16.317229 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.317198 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f85454b5-jr27m"] Jul 06 19:26:16.319454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.319431 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.321706 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.321683 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:26:16.321876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.321861 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:26:16.321949 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.321926 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:26:16.322002 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.321926 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:26:16.322063 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.322005 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v7s8x\"" Jul 06 19:26:16.322063 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.322053 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:26:16.344038 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.344011 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f85454b5-jr27m"] Jul 06 19:26:16.363540 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.363508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq9tc\" (UniqueName: \"kubernetes.io/projected/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-kube-api-access-rq9tc\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.363704 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.363555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-oauth-serving-cert\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.363704 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.363634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-serving-cert\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.363818 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.363732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-config\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.363818 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.363766 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-service-ca\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.363818 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.363794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-oauth-config\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.364679 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.364657 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn"] Jul 06 19:26:16.366700 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.366678 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.373825 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.373792 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-442xp\"" Jul 06 19:26:16.373825 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.373803 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 19:26:16.375338 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.375315 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:26:16.375591 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.375574 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 19:26:16.386447 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.386424 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn"] Jul 06 19:26:16.394374 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.394351 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2xfvz"] Jul 06 19:26:16.396347 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.396329 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.399004 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.398986 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:26:16.399408 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.399226 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rm8wk\"" Jul 06 19:26:16.399812 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.399791 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:26:16.400056 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.400038 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:26:16.464422 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-serving-cert\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.464588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464449 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-service-ca\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.464588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85b9dce3-26fb-4118-8eea-61f7cb689afc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.464588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85b9dce3-26fb-4118-8eea-61f7cb689afc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.464588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.464588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464543 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m52kk\" (UniqueName: \"kubernetes.io/projected/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-api-access-m52kk\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.464588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-config\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-textfile\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-oauth-config\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq9tc\" (UniqueName: \"kubernetes.io/projected/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-kube-api-access-rq9tc\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc888\" (UniqueName: \"kubernetes.io/projected/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-kube-api-access-zc888\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-oauth-serving-cert\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-sys\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-root\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.464957 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464944 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-metrics-client-ca\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.465539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.464997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-tls\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.465539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.465027 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.465539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.465050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-wtmp\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.465539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.465255 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-service-ca\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.465539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.465255 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-config\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.465786 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.465730 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-oauth-serving-cert\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.467373 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.467353 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-oauth-config\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.467497 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.467448 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-serving-cert\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.491113 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.491092 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq9tc\" (UniqueName: \"kubernetes.io/projected/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-kube-api-access-rq9tc\") pod \"console-76f85454b5-jr27m\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.566265 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566173 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.566443 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566354 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-root\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566443 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566411 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-metrics-client-ca\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-root\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566481 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:16.566574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-tls\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566570 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.566712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566596 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-wtmp\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:16.566712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566657 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85b9dce3-26fb-4118-8eea-61f7cb689afc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.566712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566680 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85b9dce3-26fb-4118-8eea-61f7cb689afc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.566712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566704 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.566997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m52kk\" (UniqueName: \"kubernetes.io/projected/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-api-access-m52kk\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.566997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-textfile\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566901 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-wtmp\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.566997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.566983 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-metrics-client-ca\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.567342 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc888\" (UniqueName: \"kubernetes.io/projected/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-kube-api-access-zc888\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.567342 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567023 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-textfile\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.567342 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567059 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-sys\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.567342 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567140 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-sys\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.567804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567687 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.567804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567692 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.567804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/85b9dce3-26fb-4118-8eea-61f7cb689afc-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.567804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.567738 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85b9dce3-26fb-4118-8eea-61f7cb689afc-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.568730 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.568708 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:26:16.569428 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.569064 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:26:16.569428 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.569367 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.569718 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.569698 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-tls\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.570142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.570122 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.570142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.570130 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.579406 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.579366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42b4c917-483d-42f5-be7d-6d50ad36a7b7-metrics-certs\") pod \"network-metrics-daemon-lp9vz\" (UID: \"42b4c917-483d-42f5-be7d-6d50ad36a7b7\") " pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:16.579545 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.579523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f3db58d-c59e-42a7-a906-a37a70fff592-original-pull-secret\") pod \"global-pull-secret-syncer-scm9g\" (UID: \"6f3db58d-c59e-42a7-a906-a37a70fff592\") " pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:16.609690 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.609662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m52kk\" (UniqueName: \"kubernetes.io/projected/85b9dce3-26fb-4118-8eea-61f7cb689afc-kube-api-access-m52kk\") pod \"kube-state-metrics-7c9dbb8b7d-dqpwn\" (UID: \"85b9dce3-26fb-4118-8eea-61f7cb689afc\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.628546 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.628525 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc888\" (UniqueName: \"kubernetes.io/projected/41a8548f-f04b-49a2-8b80-51ec0dbc53ad-kube-api-access-zc888\") pod \"node-exporter-2xfvz\" (UID: \"41a8548f-f04b-49a2-8b80-51ec0dbc53ad\") " pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.630510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.630473 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:16.656210 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.656180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scm9g" Jul 06 19:26:16.664332 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.664307 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qhtzw\"" Jul 06 19:26:16.667688 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.667664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:16.671719 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.671685 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lp9vz" Jul 06 19:26:16.671821 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.671791 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:26:16.677658 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.677636 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" Jul 06 19:26:16.681182 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.681161 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:26:16.695139 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.695098 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvwb\" (UniqueName: \"kubernetes.io/projected/1411d062-5009-48bd-b608-816f0b56fe37-kube-api-access-bdvwb\") pod \"network-check-target-th9jz\" (UID: \"1411d062-5009-48bd-b608-816f0b56fe37\") " pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:16.707357 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.707065 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2xfvz" Jul 06 19:26:16.810687 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.810225 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f85454b5-jr27m"] Jul 06 19:26:16.844970 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.844937 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-scm9g"] Jul 06 19:26:16.848231 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:16.848195 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3db58d_c59e_42a7_a906_a37a70fff592.slice/crio-87379454b953c84c330fe75e280ed63080c3d339d20fd12534e46fdb634f6ab6 WatchSource:0}: Error finding container 87379454b953c84c330fe75e280ed63080c3d339d20fd12534e46fdb634f6ab6: Status 404 returned error can't find the container with id 87379454b953c84c330fe75e280ed63080c3d339d20fd12534e46fdb634f6ab6 Jul 06 19:26:16.858785 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.858761 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lp9vz"] Jul 06 19:26:16.861236 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:16.861216 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b4c917_483d_42f5_be7d_6d50ad36a7b7.slice/crio-afef01f0841ce759fd2bb3c86a717cbbb230d393dcc54a88365386282bcb2ce1 WatchSource:0}: Error finding container afef01f0841ce759fd2bb3c86a717cbbb230d393dcc54a88365386282bcb2ce1: Status 404 returned error can't find the container with id afef01f0841ce759fd2bb3c86a717cbbb230d393dcc54a88365386282bcb2ce1 Jul 06 19:26:16.887502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.887372 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn"] Jul 06 19:26:16.889656 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:16.889627 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b9dce3_26fb_4118_8eea_61f7cb689afc.slice/crio-856dc284ce3808cfb2b3995774308e0e8f8cd256d67861f7d3241353cc096d32 WatchSource:0}: Error finding container 856dc284ce3808cfb2b3995774308e0e8f8cd256d67861f7d3241353cc096d32: Status 404 returned error can't find the container with id 856dc284ce3808cfb2b3995774308e0e8f8cd256d67861f7d3241353cc096d32 Jul 06 19:26:16.969321 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.969284 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkxjr\"" Jul 06 19:26:16.977534 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:16.977508 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:17.123897 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.123865 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-th9jz"] Jul 06 19:26:17.126699 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:17.126674 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1411d062_5009_48bd_b608_816f0b56fe37.slice/crio-23f7ec04c32c8788f0698fff78dcbcdfe303483ec5db143bdafef087cd785541 WatchSource:0}: Error finding container 23f7ec04c32c8788f0698fff78dcbcdfe303483ec5db143bdafef087cd785541: Status 404 returned error can't find the container with id 23f7ec04c32c8788f0698fff78dcbcdfe303483ec5db143bdafef087cd785541 Jul 06 19:26:17.197787 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.197755 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:26:17.201300 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.201279 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205157 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205157 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205161 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205302 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205405 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205447 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205555 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dh2rm\"" Jul 06 19:26:17.205617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205560 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:26:17.206047 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205683 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:26:17.206047 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.205883 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:26:17.229667 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.229636 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:26:17.249771 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.249711 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lp9vz" event={"ID":"42b4c917-483d-42f5-be7d-6d50ad36a7b7","Type":"ContainerStarted","Data":"afef01f0841ce759fd2bb3c86a717cbbb230d393dcc54a88365386282bcb2ce1"} Jul 06 19:26:17.252319 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.252290 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-th9jz" event={"ID":"1411d062-5009-48bd-b608-816f0b56fe37","Type":"ContainerStarted","Data":"23f7ec04c32c8788f0698fff78dcbcdfe303483ec5db143bdafef087cd785541"} Jul 06 19:26:17.254606 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.254491 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xfvz" event={"ID":"41a8548f-f04b-49a2-8b80-51ec0dbc53ad","Type":"ContainerStarted","Data":"f438c6488062d5baec4bace4f8a283e99792e5cc2ba5d95d242c332ac67df645"} Jul 06 19:26:17.258473 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.258420 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f85454b5-jr27m" event={"ID":"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3","Type":"ContainerStarted","Data":"c11652fe288a8a4afb542d9516196cf10be88154c57bbdb082091a24e43b103a"} Jul 06 19:26:17.260782 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.260714 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" event={"ID":"85b9dce3-26fb-4118-8eea-61f7cb689afc","Type":"ContainerStarted","Data":"856dc284ce3808cfb2b3995774308e0e8f8cd256d67861f7d3241353cc096d32"} Jul 06 19:26:17.262796 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.262767 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-scm9g" event={"ID":"6f3db58d-c59e-42a7-a906-a37a70fff592","Type":"ContainerStarted","Data":"87379454b953c84c330fe75e280ed63080c3d339d20fd12534e46fdb634f6ab6"} Jul 06 19:26:17.272265 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272375 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272375 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272375 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272322 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-volume\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272375 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272375 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272375 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k767x\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-kube-api-access-k767x\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-out\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272510 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-web-config\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.272743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.272616 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.373795 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.373705 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-out\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.373795 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.373756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-web-config\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374179 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374342 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-volume\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374504 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k767x\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-kube-api-access-k767x\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.374748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.374559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.375515 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.375461 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.376413 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.376371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.377734 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.377273 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.377734 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.377438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-out\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.378021 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.377965 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.379587 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.379561 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.380682 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.380645 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.381608 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.381566 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.382334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.382314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.382334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.382330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.382779 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.382758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-web-config\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.384824 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.384783 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-volume\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.398327 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.398278 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k767x\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-kube-api-access-k767x\") pod \"alertmanager-main-0\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.514004 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.513968 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:26:17.730313 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:17.730172 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:26:18.635667 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:18.635633 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243b7d00_48a9_4e24_9d60_e9e1639fac56.slice/crio-410617ed2e449c7d390dc8759ab6d7aa9e32ca73f4931a4f6b966824168e1c0a WatchSource:0}: Error finding container 410617ed2e449c7d390dc8759ab6d7aa9e32ca73f4931a4f6b966824168e1c0a: Status 404 returned error can't find the container with id 410617ed2e449c7d390dc8759ab6d7aa9e32ca73f4931a4f6b966824168e1c0a Jul 06 19:26:19.273337 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:19.273216 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"410617ed2e449c7d390dc8759ab6d7aa9e32ca73f4931a4f6b966824168e1c0a"} Jul 06 19:26:22.231858 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:22.231831 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5bj66" Jul 06 19:26:26.458326 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.458294 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d58b4ddff-2wmbr"] Jul 06 19:26:26.526783 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.526751 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d58b4ddff-2wmbr"] Jul 06 19:26:26.526917 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.526861 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.534474 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.534454 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:26:26.655247 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655216 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-oauth-serving-cert\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.655424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655261 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-service-ca\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.655424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-console-config\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.655424 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-oauth-config\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.655583 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-serving-cert\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.655583 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmpnw\" (UniqueName: \"kubernetes.io/projected/8a42691a-6a03-4933-a555-0ef0e0124371-kube-api-access-gmpnw\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.655583 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.655525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-trusted-ca-bundle\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.756719 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-oauth-config\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.756879 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-serving-cert\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.756879 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpnw\" (UniqueName: \"kubernetes.io/projected/8a42691a-6a03-4933-a555-0ef0e0124371-kube-api-access-gmpnw\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.756879 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-trusted-ca-bundle\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.756879 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-oauth-serving-cert\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.756879 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-service-ca\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.757155 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.756887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-console-config\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.757610 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.757585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-oauth-serving-cert\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.757706 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.757617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-console-config\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.757706 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.757676 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-service-ca\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.757791 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.757708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-trusted-ca-bundle\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.759169 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.759145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-serving-cert\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.759246 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.759224 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-oauth-config\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.766321 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.766298 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmpnw\" (UniqueName: \"kubernetes.io/projected/8a42691a-6a03-4933-a555-0ef0e0124371-kube-api-access-gmpnw\") pod \"console-5d58b4ddff-2wmbr\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:26.835856 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:26.835832 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:31.452319 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:31.452247 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d58b4ddff-2wmbr"] Jul 06 19:26:31.460550 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:26:31.460512 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a42691a_6a03_4933_a555_0ef0e0124371.slice/crio-d8d51413cb399b90a7e0a50df8468dda20e8698e3ce41dae2386b1d77376d5bb WatchSource:0}: Error finding container d8d51413cb399b90a7e0a50df8468dda20e8698e3ce41dae2386b1d77376d5bb: Status 404 returned error can't find the container with id d8d51413cb399b90a7e0a50df8468dda20e8698e3ce41dae2386b1d77376d5bb Jul 06 19:26:32.331158 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.330805 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lp9vz" event={"ID":"42b4c917-483d-42f5-be7d-6d50ad36a7b7","Type":"ContainerStarted","Data":"0eff8d6c92b2ed60166dbec0807e20cd8aeca9269e27cd2e50d0d16714eba5ac"} Jul 06 19:26:32.331158 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.330920 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lp9vz" event={"ID":"42b4c917-483d-42f5-be7d-6d50ad36a7b7","Type":"ContainerStarted","Data":"6648c7774bc8971cbd04915352b1fd3faf772f862edd3b864bd254a0640d6271"} Jul 06 19:26:32.332828 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.332801 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" exitCode=0 Jul 06 19:26:32.333022 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.332835 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} Jul 06 19:26:32.334965 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.334940 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d58b4ddff-2wmbr" event={"ID":"8a42691a-6a03-4933-a555-0ef0e0124371","Type":"ContainerStarted","Data":"8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f"} Jul 06 19:26:32.335066 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.334986 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d58b4ddff-2wmbr" event={"ID":"8a42691a-6a03-4933-a555-0ef0e0124371","Type":"ContainerStarted","Data":"d8d51413cb399b90a7e0a50df8468dda20e8698e3ce41dae2386b1d77376d5bb"} Jul 06 19:26:32.336885 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.336856 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-th9jz" event={"ID":"1411d062-5009-48bd-b608-816f0b56fe37","Type":"ContainerStarted","Data":"8d0c3f8a630d36279561cf24f426ce759f22b5a1984824cf402824856389b44e"} Jul 06 19:26:32.336995 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.336913 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:26:32.338712 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.338687 2555 generic.go:356] "Generic (PLEG): container finished" podID="41a8548f-f04b-49a2-8b80-51ec0dbc53ad" containerID="2c3204db899807afc500a16db1d1fd6a0697a7e0b94e7a3369317936f0cc76d2" exitCode=0 Jul 06 19:26:32.338816 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.338767 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xfvz" event={"ID":"41a8548f-f04b-49a2-8b80-51ec0dbc53ad","Type":"ContainerDied","Data":"2c3204db899807afc500a16db1d1fd6a0697a7e0b94e7a3369317936f0cc76d2"} Jul 06 19:26:32.341463 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.340604 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f85454b5-jr27m" event={"ID":"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3","Type":"ContainerStarted","Data":"46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a"} Jul 06 19:26:32.342585 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.342558 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dzb5w" event={"ID":"d61e31f2-7446-4c93-9e54-99255dbef4d3","Type":"ContainerStarted","Data":"9a161a9ee468836f94b14c35f10efa67c642eb3237616c895c6f042ec3030cb0"} Jul 06 19:26:32.342705 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.342690 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:32.345004 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.344978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" event={"ID":"85b9dce3-26fb-4118-8eea-61f7cb689afc","Type":"ContainerStarted","Data":"007cd69ef81a670cbcc821cb4fb7a947dae87f4028bdb704cf732c3d2e5a2452"} Jul 06 19:26:32.345101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.345027 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" event={"ID":"85b9dce3-26fb-4118-8eea-61f7cb689afc","Type":"ContainerStarted","Data":"aa12945f6265c68c51af5bfc759bd99063833690174cffc2b1879b9cdeceb402"} Jul 06 19:26:32.345101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.345055 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" event={"ID":"85b9dce3-26fb-4118-8eea-61f7cb689afc","Type":"ContainerStarted","Data":"9ba036b3cb1c922640bc7a01538f0fa85ef931c0ae4240c3353396984c91f5f9"} Jul 06 19:26:32.346840 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.346808 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-scm9g" event={"ID":"6f3db58d-c59e-42a7-a906-a37a70fff592","Type":"ContainerStarted","Data":"8e44cefeb56fd53be8070c3e74c5cd54d256f27a9f3087be4f85569b39531a1f"} Jul 06 19:26:32.350215 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.350195 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dzb5w" Jul 06 19:26:32.375776 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.375718 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lp9vz" podStartSLOduration=65.97802059200001 podStartE2EDuration="1m20.375702911s" totalImagesPullingTime="14.397682319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.371924811 +0000 UTC m=+82.250063543" watchObservedRunningTime="2026-07-06 19:26:32.375702911 +0000 UTC m=+82.253841651" Jul 06 19:26:32.400294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.400239 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d58b4ddff-2wmbr" podStartSLOduration=6.40021827 podStartE2EDuration="6.40021827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.399166499 +0000 UTC m=+82.277305249" watchObservedRunningTime="2026-07-06 19:26:32.40021827 +0000 UTC m=+82.278356996" Jul 06 19:26:32.422816 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.422761 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-th9jz" podStartSLOduration=66.290468571 podStartE2EDuration="1m20.422742113s" totalImagesPullingTime="14.132273542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.421687756 +0000 UTC m=+82.299826496" watchObservedRunningTime="2026-07-06 19:26:32.422742113 +0000 UTC m=+82.300880846" Jul 06 19:26:32.447967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.447909 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-scm9g" podStartSLOduration=66.036031576 podStartE2EDuration="1m20.447889619s" totalImagesPullingTime="14.411858043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.446769734 +0000 UTC m=+82.324908479" watchObservedRunningTime="2026-07-06 19:26:32.447889619 +0000 UTC m=+82.326028349" Jul 06 19:26:32.547047 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.546989 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dzb5w" podStartSLOduration=2.642092654 podStartE2EDuration="27.546969528s" totalImagesPullingTime="24.904876874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.546167883 +0000 UTC m=+82.424306611" watchObservedRunningTime="2026-07-06 19:26:32.546969528 +0000 UTC m=+82.425108255" Jul 06 19:26:32.576790 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.576730 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f85454b5-jr27m" podStartSLOduration=2.132812203 podStartE2EDuration="16.576707527s" totalImagesPullingTime="14.443895324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.575235208 +0000 UTC m=+82.453373937" watchObservedRunningTime="2026-07-06 19:26:32.576707527 +0000 UTC m=+82.454846257" Jul 06 19:26:32.619880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:32.619774 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqpwn" podStartSLOduration=2.251324065 podStartE2EDuration="16.619750435s" totalImagesPullingTime="14.36842637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:32.619573997 +0000 UTC m=+82.497712729" watchObservedRunningTime="2026-07-06 19:26:32.619750435 +0000 UTC m=+82.497889163" Jul 06 19:26:33.355090 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:33.355019 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xfvz" event={"ID":"41a8548f-f04b-49a2-8b80-51ec0dbc53ad","Type":"ContainerStarted","Data":"cc5d40fe71f9bc9f3f89cafc3b5777f1139d1af384a46b8e241491d919de0981"} Jul 06 19:26:33.355090 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:33.355073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xfvz" event={"ID":"41a8548f-f04b-49a2-8b80-51ec0dbc53ad","Type":"ContainerStarted","Data":"e7d4b3811c0c3620706449d2372fd38ae08c1f582870ebf25fa642f1b2ffa1e1"} Jul 06 19:26:33.380279 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:33.380215 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2xfvz" podStartSLOduration=3.009488025 podStartE2EDuration="17.380195074s" totalImagesPullingTime="14.2018235s" totalInitContainerRuntime="168.883549ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:33.378125264 +0000 UTC m=+83.256263992" watchObservedRunningTime="2026-07-06 19:26:33.380195074 +0000 UTC m=+83.258333803" Jul 06 19:26:35.367105 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:35.367065 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} Jul 06 19:26:35.367554 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:35.367145 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} Jul 06 19:26:35.367554 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:35.367171 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} Jul 06 19:26:35.367554 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:35.367197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} Jul 06 19:26:35.367554 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:35.367237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} Jul 06 19:26:36.378439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.378372 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerStarted","Data":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} Jul 06 19:26:36.452635 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.452541 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.515384452 podStartE2EDuration="19.452519285s" totalImagesPullingTime="15.903117155s" totalInitContainerRuntime="34.017678ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:36.451189059 +0000 UTC m=+86.329327788" watchObservedRunningTime="2026-07-06 19:26:36.452519285 +0000 UTC m=+86.330658014" Jul 06 19:26:36.631059 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.630972 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:36.631059 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.631048 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:36.636764 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.636739 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:36.836446 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.836408 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:36.836634 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.836477 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:36.842102 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:36.842076 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:37.387240 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:37.387207 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:26:37.387790 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:37.387672 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:26:37.492597 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:26:37.492562 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f85454b5-jr27m"] Jul 06 19:27:03.359100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:03.359071 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-th9jz" Jul 06 19:27:04.414890 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.414852 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76f85454b5-jr27m" podUID="0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" containerName="console" containerID="cri-o://46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a" gracePeriod=15 Jul 06 19:27:04.679089 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.679025 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:27:04.766913 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.766879 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-oauth-config\") pod \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " Jul 06 19:27:04.766913 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.766914 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-oauth-serving-cert\") pod \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " Jul 06 19:27:04.767107 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.766963 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-serving-cert\") pod \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " Jul 06 19:27:04.767153 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.767131 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq9tc\" (UniqueName: \"kubernetes.io/projected/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-kube-api-access-rq9tc\") pod \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " Jul 06 19:27:04.767204 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.767189 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-service-ca\") pod \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " Jul 06 19:27:04.767258 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.767220 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-config\") pod \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\" (UID: \"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3\") " Jul 06 19:27:04.767502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.767454 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" (UID: "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:04.767606 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.767557 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" (UID: "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:04.767655 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.767631 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-config" (OuterVolumeSpecName: "console-config") pod "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" (UID: "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:27:04.769370 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.769330 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" (UID: "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:04.769587 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.769563 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" (UID: "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:27:04.769630 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.769565 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-kube-api-access-rq9tc" (OuterVolumeSpecName: "kube-api-access-rq9tc") pod "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" (UID: "0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3"). InnerVolumeSpecName "kube-api-access-rq9tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:27:04.868606 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.868575 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:27:04.868606 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.868600 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq9tc\" (UniqueName: \"kubernetes.io/projected/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-kube-api-access-rq9tc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:27:04.868787 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.868614 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:27:04.868787 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.868627 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:27:04.868787 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.868637 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-console-oauth-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:27:04.868787 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:04.868648 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3-oauth-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:27:05.487012 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.486977 2555 generic.go:356] "Generic (PLEG): container finished" podID="0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" containerID="46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a" exitCode=0 Jul 06 19:27:05.487411 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.487027 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f85454b5-jr27m" event={"ID":"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3","Type":"ContainerDied","Data":"46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a"} Jul 06 19:27:05.487411 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.487064 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f85454b5-jr27m" event={"ID":"0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3","Type":"ContainerDied","Data":"c11652fe288a8a4afb542d9516196cf10be88154c57bbdb082091a24e43b103a"} Jul 06 19:27:05.487411 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.487083 2555 scope.go:117] "RemoveContainer" containerID="46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a" Jul 06 19:27:05.487411 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.487028 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f85454b5-jr27m" Jul 06 19:27:05.495411 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.495378 2555 scope.go:117] "RemoveContainer" containerID="46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a" Jul 06 19:27:05.495662 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:27:05.495644 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a\": container with ID starting with 46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a not found: ID does not exist" containerID="46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a" Jul 06 19:27:05.495714 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.495671 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a"} err="failed to get container status \"46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a\": rpc error: code = NotFound desc = could not find container \"46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a\": container with ID starting with 46ba03b1ad6cae8bef645d20f036f68272cace01812f4cc08917d20aa127455a not found: ID does not exist" Jul 06 19:27:05.507524 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.507501 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f85454b5-jr27m"] Jul 06 19:27:05.513239 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.513220 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f85454b5-jr27m"] Jul 06 19:27:05.849801 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:27:05.849769 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" path="/var/lib/kubelet/pods/0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3/volumes" Jul 06 19:30:11.659157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:30:11.659132 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:31:21.941322 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:21.941287 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:31:22.325338 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.325281 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="alertmanager" containerID="cri-o://70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" gracePeriod=120 Jul 06 19:31:22.325563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.325342 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="config-reloader" containerID="cri-o://b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" gracePeriod=120 Jul 06 19:31:22.325563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.325342 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-metric" containerID="cri-o://d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" gracePeriod=120 Jul 06 19:31:22.325563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.325334 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-web" containerID="cri-o://08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" gracePeriod=120 Jul 06 19:31:22.325563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.325369 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy" containerID="cri-o://68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" gracePeriod=120 Jul 06 19:31:22.325563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.325508 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="prom-label-proxy" containerID="cri-o://7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" gracePeriod=120 Jul 06 19:31:22.566431 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.566408 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:22.692325 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692240 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-cluster-tls-config\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692325 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692295 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-out\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692338 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-volume\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692360 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-metrics-client-ca\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692407 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-web\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692445 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692479 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-tls-assets\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692509 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-main-db\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692552 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-main-tls\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692584 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692626 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k767x\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-kube-api-access-k767x\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692657 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-web-config\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692684 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-trusted-ca-bundle\") pod \"243b7d00-48a9-4e24-9d60-e9e1639fac56\" (UID: \"243b7d00-48a9-4e24-9d60-e9e1639fac56\") " Jul 06 19:31:22.692936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692779 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:31:22.692936 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.692915 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-metrics-client-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.693228 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.693149 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:31:22.695160 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.694821 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:22.695694 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.695657 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-volume" (OuterVolumeSpecName: "config-volume") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.695857 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.695739 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-out" (OuterVolumeSpecName: "config-out") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:22.696406 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.696364 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.696406 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.696381 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:22.696576 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.696493 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.696576 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.696540 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.696733 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.696620 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.696951 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.696933 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-kube-api-access-k767x" (OuterVolumeSpecName: "kube-api-access-k767x") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "kube-api-access-k767x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:22.699342 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.699149 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.705770 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.705749 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-web-config" (OuterVolumeSpecName: "web-config") pod "243b7d00-48a9-4e24-9d60-e9e1639fac56" (UID: "243b7d00-48a9-4e24-9d60-e9e1639fac56"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:31:22.793748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793724 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-main-tls\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793747 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793758 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k767x\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-kube-api-access-k767x\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793767 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-web-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793775 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793784 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-cluster-tls-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793794 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-out\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793802 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793810 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793818 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/243b7d00-48a9-4e24-9d60-e9e1639fac56-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793829 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/243b7d00-48a9-4e24-9d60-e9e1639fac56-tls-assets\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:22.793869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:22.793837 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/243b7d00-48a9-4e24-9d60-e9e1639fac56-alertmanager-main-db\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:31:23.331452 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331418 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" exitCode=0 Jul 06 19:31:23.331452 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331449 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" exitCode=0 Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331459 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" exitCode=0 Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331468 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" exitCode=0 Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331475 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" exitCode=0 Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331484 2555 generic.go:356] "Generic (PLEG): container finished" podID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" exitCode=0 Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331507 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331505 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331606 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331652 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331672 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331696 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331741 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} Jul 06 19:31:23.331955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.331822 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"243b7d00-48a9-4e24-9d60-e9e1639fac56","Type":"ContainerDied","Data":"410617ed2e449c7d390dc8759ab6d7aa9e32ca73f4931a4f6b966824168e1c0a"} Jul 06 19:31:23.343518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.343499 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.350088 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.350073 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.356206 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.356179 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.359811 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.359788 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:31:23.362894 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.362878 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.366460 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.366443 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:31:23.369708 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.369693 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.376052 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.376036 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.381959 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.381943 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.382177 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.382156 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.382230 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.382185 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} err="failed to get container status \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" Jul 06 19:31:23.382230 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.382210 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.382475 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.382452 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.382475 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.382469 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} err="failed to get container status \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" Jul 06 19:31:23.382584 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.382483 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.382745 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.382728 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.382809 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.382754 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} err="failed to get container status \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" Jul 06 19:31:23.382809 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.382775 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.383028 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.383009 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.383082 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383033 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} err="failed to get container status \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" Jul 06 19:31:23.383082 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383048 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.383291 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.383275 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.383339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383293 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} err="failed to get container status \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" Jul 06 19:31:23.383339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383313 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.383556 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.383535 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.383612 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383562 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} err="failed to get container status \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" Jul 06 19:31:23.383612 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383576 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.383793 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:31:23.383777 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.383839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383796 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} err="failed to get container status \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" Jul 06 19:31:23.383839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383810 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.384004 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.383986 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} err="failed to get container status \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" Jul 06 19:31:23.384067 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384006 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.384199 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384183 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} err="failed to get container status \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" Jul 06 19:31:23.384243 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384199 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.384369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384353 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} err="failed to get container status \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" Jul 06 19:31:23.384444 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384370 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.384575 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384558 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} err="failed to get container status \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" Jul 06 19:31:23.384614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384577 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.384754 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384738 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} err="failed to get container status \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" Jul 06 19:31:23.384795 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384754 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.384951 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384931 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} err="failed to get container status \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" Jul 06 19:31:23.384994 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.384952 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.385143 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385124 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} err="failed to get container status \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" Jul 06 19:31:23.385213 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385146 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.385344 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385328 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} err="failed to get container status \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" Jul 06 19:31:23.385402 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385345 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.385543 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385526 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} err="failed to get container status \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" Jul 06 19:31:23.385592 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385544 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.385766 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385744 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} err="failed to get container status \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" Jul 06 19:31:23.385766 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385765 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.385985 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385967 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} err="failed to get container status \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" Jul 06 19:31:23.385985 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.385985 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.386261 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.386240 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} err="failed to get container status \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" Jul 06 19:31:23.386343 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.386262 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.386586 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.386555 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} err="failed to get container status \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" Jul 06 19:31:23.386586 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.386579 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.386825 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.386801 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} err="failed to get container status \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" Jul 06 19:31:23.386825 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.386824 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.387069 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387051 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} err="failed to get container status \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" Jul 06 19:31:23.387121 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387071 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.387303 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387286 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} err="failed to get container status \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" Jul 06 19:31:23.387370 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387304 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.387544 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387528 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} err="failed to get container status \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" Jul 06 19:31:23.387544 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387543 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.387747 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387729 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} err="failed to get container status \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" Jul 06 19:31:23.387788 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387749 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.387967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387951 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} err="failed to get container status \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" Jul 06 19:31:23.388010 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.387968 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.388134 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388118 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} err="failed to get container status \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" Jul 06 19:31:23.388187 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388134 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.388349 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388330 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} err="failed to get container status \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" Jul 06 19:31:23.388419 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388350 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.388564 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388547 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} err="failed to get container status \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" Jul 06 19:31:23.388614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388563 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.388775 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388757 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} err="failed to get container status \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" Jul 06 19:31:23.388826 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388777 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.388975 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388957 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} err="failed to get container status \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" Jul 06 19:31:23.389016 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.388976 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.389176 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389162 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} err="failed to get container status \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" Jul 06 19:31:23.389220 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389177 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.389374 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389346 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} err="failed to get container status \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" Jul 06 19:31:23.389427 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389374 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.389563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389547 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} err="failed to get container status \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" Jul 06 19:31:23.389599 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389565 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.389765 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389751 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} err="failed to get container status \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" Jul 06 19:31:23.389808 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389765 2555 scope.go:117] "RemoveContainer" containerID="7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299" Jul 06 19:31:23.389948 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389930 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299"} err="failed to get container status \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": rpc error: code = NotFound desc = could not find container \"7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299\": container with ID starting with 7e1b5f7b39fb29e010cd32c2bd7df052b9bc3dd2df1c25ef86d06f9337c22299 not found: ID does not exist" Jul 06 19:31:23.389997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.389949 2555 scope.go:117] "RemoveContainer" containerID="d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc" Jul 06 19:31:23.390162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390145 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc"} err="failed to get container status \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": rpc error: code = NotFound desc = could not find container \"d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc\": container with ID starting with d188994833a8aa82d60b56c282f9be180039cd2c47be84780d204452673346cc not found: ID does not exist" Jul 06 19:31:23.390220 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390162 2555 scope.go:117] "RemoveContainer" containerID="68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6" Jul 06 19:31:23.390471 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390371 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6"} err="failed to get container status \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": rpc error: code = NotFound desc = could not find container \"68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6\": container with ID starting with 68754d3b0991ad4d9cb51a438913b3814a588b6be2038fadd82d473a6fb438a6 not found: ID does not exist" Jul 06 19:31:23.390551 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390474 2555 scope.go:117] "RemoveContainer" containerID="08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259" Jul 06 19:31:23.390726 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390705 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259"} err="failed to get container status \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": rpc error: code = NotFound desc = could not find container \"08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259\": container with ID starting with 08b725b91ad7d03bc2c8d363f6308d997f6e245cfcc9405c7892932e85bb2259 not found: ID does not exist" Jul 06 19:31:23.390726 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390724 2555 scope.go:117] "RemoveContainer" containerID="b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae" Jul 06 19:31:23.390911 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390895 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae"} err="failed to get container status \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": rpc error: code = NotFound desc = could not find container \"b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae\": container with ID starting with b75b4b52718077766379af18156a1834b1ded84eb52be3bafc0aa1732d5652ae not found: ID does not exist" Jul 06 19:31:23.390911 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.390911 2555 scope.go:117] "RemoveContainer" containerID="70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8" Jul 06 19:31:23.391147 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.391129 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8"} err="failed to get container status \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": rpc error: code = NotFound desc = could not find container \"70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8\": container with ID starting with 70f3ce1c9b00c8e410e95cf00a2da0db51c22757cca0434e395b4b3deadd38b8 not found: ID does not exist" Jul 06 19:31:23.391222 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.391149 2555 scope.go:117] "RemoveContainer" containerID="7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309" Jul 06 19:31:23.391354 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.391338 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309"} err="failed to get container status \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": rpc error: code = NotFound desc = could not find container \"7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309\": container with ID starting with 7c1face97af008fc16be3db73724431647b8f8b70b6543473a34b5b7381d8309 not found: ID does not exist" Jul 06 19:31:23.398253 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:31:23.398500 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398487 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="init-config-reloader" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398502 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="init-config-reloader" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398513 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="alertmanager" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398519 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="alertmanager" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398525 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="config-reloader" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398530 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="config-reloader" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398536 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-web" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398541 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-web" Jul 06 19:31:23.398548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398547 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398553 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398562 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-metric" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398569 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-metric" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398576 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="prom-label-proxy" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398582 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="prom-label-proxy" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398589 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" containerName="console" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398594 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" containerName="console" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398638 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="config-reloader" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398647 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ee58a47-4009-4bf8-aa97-6f35ed7a7ec3" containerName="console" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398654 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-web" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398659 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398665 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="alertmanager" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398670 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="kube-rbac-proxy-metric" Jul 06 19:31:23.398804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.398675 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" containerName="prom-label-proxy" Jul 06 19:31:23.400783 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.400769 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.403048 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403019 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:31:23.403130 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403060 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:31:23.403196 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403185 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:31:23.403257 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403198 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:31:23.403401 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403368 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:31:23.403401 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403376 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:31:23.403581 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403413 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:31:23.403581 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403471 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dh2rm\"" Jul 06 19:31:23.403581 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.403537 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:31:23.411556 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.411539 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:31:23.419673 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.419654 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:31:23.498919 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.498890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c772280d-9211-4ece-ad0e-1318d647f044-config-out\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499104 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.498924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499104 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.498948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499104 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499004 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c772280d-9211-4ece-ad0e-1318d647f044-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499104 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499168 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-web-config\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499192 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pq5\" (UniqueName: \"kubernetes.io/projected/c772280d-9211-4ece-ad0e-1318d647f044-kube-api-access-h4pq5\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c772280d-9211-4ece-ad0e-1318d647f044-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499286 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c772280d-9211-4ece-ad0e-1318d647f044-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c772280d-9211-4ece-ad0e-1318d647f044-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.499581 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.499331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-config-volume\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600331 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-web-config\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600331 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pq5\" (UniqueName: \"kubernetes.io/projected/c772280d-9211-4ece-ad0e-1318d647f044-kube-api-access-h4pq5\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600331 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600321 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c772280d-9211-4ece-ad0e-1318d647f044-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c772280d-9211-4ece-ad0e-1318d647f044-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c772280d-9211-4ece-ad0e-1318d647f044-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.600760 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-config-volume\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.600981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c772280d-9211-4ece-ad0e-1318d647f044-config-out\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601048 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601091 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601124 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c772280d-9211-4ece-ad0e-1318d647f044-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601158 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c772280d-9211-4ece-ad0e-1318d647f044-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601166 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601561 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.601618 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.601596 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c772280d-9211-4ece-ad0e-1318d647f044-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.604307 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.603789 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.604307 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.603789 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-web-config\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.604307 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.604153 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-config-volume\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.604307 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.604167 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c772280d-9211-4ece-ad0e-1318d647f044-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.604307 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.604247 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.608610 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.605136 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c772280d-9211-4ece-ad0e-1318d647f044-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.608610 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.606083 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c772280d-9211-4ece-ad0e-1318d647f044-config-out\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.608610 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.606313 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.608610 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.606670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.609372 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.609352 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c772280d-9211-4ece-ad0e-1318d647f044-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.610757 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.610739 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pq5\" (UniqueName: \"kubernetes.io/projected/c772280d-9211-4ece-ad0e-1318d647f044-kube-api-access-h4pq5\") pod \"alertmanager-main-0\" (UID: \"c772280d-9211-4ece-ad0e-1318d647f044\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.710469 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.710435 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:31:23.842585 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.842551 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:31:23.845356 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:31:23.845331 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc772280d_9211_4ece_ad0e_1318d647f044.slice/crio-dc9d579f1b8f5571e8bd9a05322c24194645bfdf4c70d5292927ca57fc53758c WatchSource:0}: Error finding container dc9d579f1b8f5571e8bd9a05322c24194645bfdf4c70d5292927ca57fc53758c: Status 404 returned error can't find the container with id dc9d579f1b8f5571e8bd9a05322c24194645bfdf4c70d5292927ca57fc53758c Jul 06 19:31:23.849229 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:23.849202 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243b7d00-48a9-4e24-9d60-e9e1639fac56" path="/var/lib/kubelet/pods/243b7d00-48a9-4e24-9d60-e9e1639fac56/volumes" Jul 06 19:31:24.337261 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:24.337219 2555 generic.go:356] "Generic (PLEG): container finished" podID="c772280d-9211-4ece-ad0e-1318d647f044" containerID="3de8f299067d1a1b6901eb54b9ed7a181906d1eb490dbf1a9814297a8afd8578" exitCode=0 Jul 06 19:31:24.337663 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:24.337305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerDied","Data":"3de8f299067d1a1b6901eb54b9ed7a181906d1eb490dbf1a9814297a8afd8578"} Jul 06 19:31:24.337663 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:24.337383 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"dc9d579f1b8f5571e8bd9a05322c24194645bfdf4c70d5292927ca57fc53758c"} Jul 06 19:31:25.344888 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.344846 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"3eb3f13242910e84c96006bc47b71fadc0a3e0fa65456052521240de798c7145"} Jul 06 19:31:25.345343 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.344925 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"f23477b6a028e2df766ac7809c26fc09fb065ab2646bf33b7f9a4e60fbeae854"} Jul 06 19:31:25.345343 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.344969 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"7e7631f101c4dbbae7479ab909e43a35eb043f1f77a0dae89ec1de1c4b29519c"} Jul 06 19:31:25.345343 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.345051 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"8219ad2bc5c57bd6993122a5953aa98ce3d4cda8a2608eecee48a1ca5b147d3d"} Jul 06 19:31:25.345343 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.345091 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"eeb841b2475acbf8a1b0d7f1515df85c11e7620b1dba61a6cb3564dcc4ac6eee"} Jul 06 19:31:25.345343 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.345137 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c772280d-9211-4ece-ad0e-1318d647f044","Type":"ContainerStarted","Data":"a54c16c8e9f8cae84b85aa8f8e8938e290ee18778833c1aa79db47f0fb9d7c0a"} Jul 06 19:31:25.376881 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:25.376819 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.359607633 podStartE2EDuration="2.376798553s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.19092ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:25.375276458 +0000 UTC m=+375.253415183" watchObservedRunningTime="2026-07-06 19:31:25.376798553 +0000 UTC m=+375.254937283" Jul 06 19:31:26.001336 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.001298 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75799c5ff7-xtrhf"] Jul 06 19:31:26.003877 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.003855 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.007229 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.007211 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:31:26.007361 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.007209 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:31:26.007361 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.007237 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:31:26.007617 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.007599 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mhg5d\"" Jul 06 19:31:26.007710 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.007627 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:31:26.007710 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.007652 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:31:26.017839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.017810 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:31:26.022149 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.022126 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75799c5ff7-xtrhf"] Jul 06 19:31:26.119923 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.119902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-metrics-client-ca\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120041 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.119935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-telemeter-client-tls\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120041 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.119953 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120041 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.119988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120041 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.120019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-secret-telemeter-client\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120041 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.120037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-serving-certs-ca-bundle\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120206 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.120071 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-federate-client-tls\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.120206 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.120121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2f8l\" (UniqueName: \"kubernetes.io/projected/140f2f6d-2026-4629-9c74-6f140690917b-kube-api-access-d2f8l\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.220676 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.220676 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-secret-telemeter-client\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.220839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-serving-certs-ca-bundle\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.220896 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-federate-client-tls\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.220953 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2f8l\" (UniqueName: \"kubernetes.io/projected/140f2f6d-2026-4629-9c74-6f140690917b-kube-api-access-d2f8l\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.220953 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-metrics-client-ca\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.221048 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.220978 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-telemeter-client-tls\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.221048 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.221006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.221450 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.221423 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-serving-certs-ca-bundle\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.221722 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.221679 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-metrics-client-ca\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.221807 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.221727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/140f2f6d-2026-4629-9c74-6f140690917b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.223203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.223177 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-federate-client-tls\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.223347 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.223328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-telemeter-client-tls\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.223673 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.223652 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.223725 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.223706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/140f2f6d-2026-4629-9c74-6f140690917b-secret-telemeter-client\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.231630 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.231611 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2f8l\" (UniqueName: \"kubernetes.io/projected/140f2f6d-2026-4629-9c74-6f140690917b-kube-api-access-d2f8l\") pod \"telemeter-client-75799c5ff7-xtrhf\" (UID: \"140f2f6d-2026-4629-9c74-6f140690917b\") " pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.318115 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.318061 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" Jul 06 19:31:26.451827 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.451796 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75799c5ff7-xtrhf"] Jul 06 19:31:26.455630 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:31:26.455607 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140f2f6d_2026_4629_9c74_6f140690917b.slice/crio-2c386f928cd992111788277f8e7ee9437dd70b3d3ecbeaa8c1f860e04e4c6bf8 WatchSource:0}: Error finding container 2c386f928cd992111788277f8e7ee9437dd70b3d3ecbeaa8c1f860e04e4c6bf8: Status 404 returned error can't find the container with id 2c386f928cd992111788277f8e7ee9437dd70b3d3ecbeaa8c1f860e04e4c6bf8 Jul 06 19:31:26.457627 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:26.457610 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:31:27.290339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.290297 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:31:27.293596 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.293578 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.296918 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.296889 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:31:27.296918 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.296912 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:31:27.297101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297078 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:31:27.297157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297113 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:31:27.297198 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297178 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:31:27.297285 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297246 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:31:27.297350 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297326 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:31:27.297840 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297811 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:31:27.298081 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.297867 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:31:27.298081 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.298009 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2fps8\"" Jul 06 19:31:27.298184 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.298012 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:31:27.298535 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.298512 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:31:27.298874 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.298848 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:31:27.298874 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.298847 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eou1avq8hp48\"" Jul 06 19:31:27.299026 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.298931 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:31:27.301613 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.301561 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:31:27.303381 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.303362 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:31:27.318054 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.318028 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:31:27.359327 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.359277 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" event={"ID":"140f2f6d-2026-4629-9c74-6f140690917b","Type":"ContainerStarted","Data":"2c386f928cd992111788277f8e7ee9437dd70b3d3ecbeaa8c1f860e04e4c6bf8"} Jul 06 19:31:27.431329 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431329 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431329 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431523 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431523 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431523 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab64fff-1364-4f45-a829-3ab6c3b13352-config-out\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431523 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431563 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431586 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab64fff-1364-4f45-a829-3ab6c3b13352-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlxh\" (UniqueName: \"kubernetes.io/projected/dab64fff-1364-4f45-a829-3ab6c3b13352-kube-api-access-smlxh\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431690 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-web-config\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431729 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.431839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.432002 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.431845 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-config\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.532725 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532829 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab64fff-1364-4f45-a829-3ab6c3b13352-config-out\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532862 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533178 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.532943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533624 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab64fff-1364-4f45-a829-3ab6c3b13352-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533624 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533599 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smlxh\" (UniqueName: \"kubernetes.io/projected/dab64fff-1364-4f45-a829-3ab6c3b13352-kube-api-access-smlxh\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-web-config\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533717 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533918 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.533918 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.533781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.534161 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.534136 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.534683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.534638 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.534892 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.534823 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.535232 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.535201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.535713 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.535684 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.535797 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.535771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.535868 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.535828 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.535920 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.535864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.535920 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.535900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-config\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.536750 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.536724 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.537748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.537707 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dab64fff-1364-4f45-a829-3ab6c3b13352-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540125 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.539417 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540125 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.539640 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab64fff-1364-4f45-a829-3ab6c3b13352-config-out\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540125 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.539660 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540125 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.540050 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540427 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.540314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.540482 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-web-config\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540665 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.540637 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.540955 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.540928 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.541306 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.541286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-config\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.541832 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.541809 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dab64fff-1364-4f45-a829-3ab6c3b13352-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.542612 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.542591 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab64fff-1364-4f45-a829-3ab6c3b13352-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.547245 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.547223 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlxh\" (UniqueName: \"kubernetes.io/projected/dab64fff-1364-4f45-a829-3ab6c3b13352-kube-api-access-smlxh\") pod \"prometheus-k8s-0\" (UID: \"dab64fff-1364-4f45-a829-3ab6c3b13352\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.605826 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.605788 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:27.761997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:27.761961 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:31:27.765081 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:31:27.765053 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab64fff_1364_4f45_a829_3ab6c3b13352.slice/crio-99aafb13918f84bdad81d53009dd85bab05d3ae8fcc676d7a015b1e18193be24 WatchSource:0}: Error finding container 99aafb13918f84bdad81d53009dd85bab05d3ae8fcc676d7a015b1e18193be24: Status 404 returned error can't find the container with id 99aafb13918f84bdad81d53009dd85bab05d3ae8fcc676d7a015b1e18193be24 Jul 06 19:31:28.364472 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:28.364438 2555 generic.go:356] "Generic (PLEG): container finished" podID="dab64fff-1364-4f45-a829-3ab6c3b13352" containerID="74ab5a7038cccb3a829a7cf34b3912e24f2718b1c07623d63836f74c199c62f1" exitCode=0 Jul 06 19:31:28.364614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:28.364524 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerDied","Data":"74ab5a7038cccb3a829a7cf34b3912e24f2718b1c07623d63836f74c199c62f1"} Jul 06 19:31:28.364672 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:28.364616 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"99aafb13918f84bdad81d53009dd85bab05d3ae8fcc676d7a015b1e18193be24"} Jul 06 19:31:29.370715 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:29.370678 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" event={"ID":"140f2f6d-2026-4629-9c74-6f140690917b","Type":"ContainerStarted","Data":"d25ffe3b700a5a04c09ab8800b39c0ff8014e06883fb3db8ba42f1ce5aba18e4"} Jul 06 19:31:29.371157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:29.370752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" event={"ID":"140f2f6d-2026-4629-9c74-6f140690917b","Type":"ContainerStarted","Data":"23195aa7b266913cd56069cfa5b4731a0ff6bb6ce85eb51ff0ef27bc60335be0"} Jul 06 19:31:29.371157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:29.370780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" event={"ID":"140f2f6d-2026-4629-9c74-6f140690917b","Type":"ContainerStarted","Data":"233a87635d602fe51fe213878ec75dde784f9b6cdb370d55f89d9a7e43f984de"} Jul 06 19:31:29.397666 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:29.397616 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75799c5ff7-xtrhf" podStartSLOduration=1.86366301 podStartE2EDuration="4.397599068s" totalImagesPullingTime="2.533936058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:29.395157959 +0000 UTC m=+379.273296725" watchObservedRunningTime="2026-07-06 19:31:29.397599068 +0000 UTC m=+379.275737798" Jul 06 19:31:30.163864 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.163831 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fc44bbf7-c2lqr"] Jul 06 19:31:30.167104 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.166545 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.183535 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.183513 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc44bbf7-c2lqr"] Jul 06 19:31:30.259513 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259479 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-oauth-config\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.259677 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259521 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-config\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.259677 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-trusted-ca-bundle\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.259677 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259572 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-service-ca\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.259677 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259616 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-oauth-serving-cert\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.259844 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tvn\" (UniqueName: \"kubernetes.io/projected/60076f0c-4f36-4f85-bd6a-49cce060bad9-kube-api-access-84tvn\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.259844 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.259748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-serving-cert\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.360812 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.360775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tvn\" (UniqueName: \"kubernetes.io/projected/60076f0c-4f36-4f85-bd6a-49cce060bad9-kube-api-access-84tvn\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.360812 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.360816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-serving-cert\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361059 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.360841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-oauth-config\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361059 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.360876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-config\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361059 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.360900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-trusted-ca-bundle\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361059 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.360923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-service-ca\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361237 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.361075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-oauth-serving-cert\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361803 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.361772 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-config\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361919 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.361815 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-service-ca\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.361919 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.361831 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-oauth-serving-cert\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.362078 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.361998 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-trusted-ca-bundle\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.363500 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.363463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-serving-cert\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.363820 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.363802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-oauth-config\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.380651 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.380624 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tvn\" (UniqueName: \"kubernetes.io/projected/60076f0c-4f36-4f85-bd6a-49cce060bad9-kube-api-access-84tvn\") pod \"console-5fc44bbf7-c2lqr\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.480128 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.480032 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:30.643357 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:30.643311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc44bbf7-c2lqr"] Jul 06 19:31:30.649933 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:31:30.649902 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60076f0c_4f36_4f85_bd6a_49cce060bad9.slice/crio-5c7d0274c8f25ee1470404ae76f5e346de17fce7f0bba30e76e61bf086d5c81a WatchSource:0}: Error finding container 5c7d0274c8f25ee1470404ae76f5e346de17fce7f0bba30e76e61bf086d5c81a: Status 404 returned error can't find the container with id 5c7d0274c8f25ee1470404ae76f5e346de17fce7f0bba30e76e61bf086d5c81a Jul 06 19:31:31.381006 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:31.380967 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc44bbf7-c2lqr" event={"ID":"60076f0c-4f36-4f85-bd6a-49cce060bad9","Type":"ContainerStarted","Data":"03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e"} Jul 06 19:31:31.381442 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:31.381030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc44bbf7-c2lqr" event={"ID":"60076f0c-4f36-4f85-bd6a-49cce060bad9","Type":"ContainerStarted","Data":"5c7d0274c8f25ee1470404ae76f5e346de17fce7f0bba30e76e61bf086d5c81a"} Jul 06 19:31:31.404036 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:31.403970 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fc44bbf7-c2lqr" podStartSLOduration=1.403947522 podStartE2EDuration="1.403947522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:31.402523082 +0000 UTC m=+381.280661812" watchObservedRunningTime="2026-07-06 19:31:31.403947522 +0000 UTC m=+381.282086252" Jul 06 19:31:32.387255 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:32.387218 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"5da333c89597ec578ff23dc99e1ccd22242c239b1af1f1dee38c518f33091396"} Jul 06 19:31:32.387691 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:32.387286 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"9f74120d0455f519e559ec2c15d9c6d1efc8db208f83d7783055e014860e6cde"} Jul 06 19:31:34.404992 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:34.404962 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"87ebdb83133e4b6b006320f0627d7c4aba42af0471b0c92bbd3ef87f8d55fc75"} Jul 06 19:31:35.412313 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:35.412276 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"3b52591b6e6a6e62b295d9e1164b0db0c37a68cd8c173efc2f34f4fe789e66d1"} Jul 06 19:31:35.412676 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:35.412339 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"b946f48d777b16a5a949cde1c902facbfffa1f751ddbd6d102cd4d2ee77dc32f"} Jul 06 19:31:35.412676 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:35.412365 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dab64fff-1364-4f45-a829-3ab6c3b13352","Type":"ContainerStarted","Data":"fbbcafc7d442954930e16829164b8fd43dd41a08fbf5a10d2a6357b81bc862e8"} Jul 06 19:31:35.444722 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:35.444662 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5859068020000002 podStartE2EDuration="8.444642454s" totalImagesPullingTime="5.837936884s" totalInitContainerRuntime="20.798768ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:35.443501278 +0000 UTC m=+385.321640005" watchObservedRunningTime="2026-07-06 19:31:35.444642454 +0000 UTC m=+385.322781183" Jul 06 19:31:37.605970 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:37.605921 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:31:40.480641 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:40.480608 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:40.480968 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:40.480711 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:40.485380 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:40.485358 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:41.440539 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:41.440509 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:31:41.489358 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:31:41.489320 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d58b4ddff-2wmbr"] Jul 06 19:32:06.509326 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.509259 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d58b4ddff-2wmbr" podUID="8a42691a-6a03-4933-a555-0ef0e0124371" containerName="console" containerID="cri-o://8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f" gracePeriod=15 Jul 06 19:32:06.771292 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.771240 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:32:06.853202 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853175 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-console-config\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853352 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853212 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-trusted-ca-bundle\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853352 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853238 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-oauth-config\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853352 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853273 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-oauth-serving-cert\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853352 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853311 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-service-ca\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853352 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853334 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-serving-cert\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853616 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853420 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmpnw\" (UniqueName: \"kubernetes.io/projected/8a42691a-6a03-4933-a555-0ef0e0124371-kube-api-access-gmpnw\") pod \"8a42691a-6a03-4933-a555-0ef0e0124371\" (UID: \"8a42691a-6a03-4933-a555-0ef0e0124371\") " Jul 06 19:32:06.853705 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853647 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-console-config" (OuterVolumeSpecName: "console-config") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:32:06.853767 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853740 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:32:06.853826 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853761 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:32:06.853826 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.853808 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:32:06.855451 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.855409 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:32:06.855574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.855492 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:32:06.855574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.855489 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a42691a-6a03-4933-a555-0ef0e0124371-kube-api-access-gmpnw" (OuterVolumeSpecName: "kube-api-access-gmpnw") pod "8a42691a-6a03-4933-a555-0ef0e0124371" (UID: "8a42691a-6a03-4933-a555-0ef0e0124371"). InnerVolumeSpecName "kube-api-access-gmpnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:32:06.954582 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954544 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-trusted-ca-bundle\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:06.954582 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954576 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-oauth-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:06.954582 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954586 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-oauth-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:06.954582 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954595 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:06.954816 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954606 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a42691a-6a03-4933-a555-0ef0e0124371-console-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:06.954816 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954614 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmpnw\" (UniqueName: \"kubernetes.io/projected/8a42691a-6a03-4933-a555-0ef0e0124371-kube-api-access-gmpnw\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:06.954816 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:06.954624 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a42691a-6a03-4933-a555-0ef0e0124371-console-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:32:07.532141 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.532109 2555 generic.go:356] "Generic (PLEG): container finished" podID="8a42691a-6a03-4933-a555-0ef0e0124371" containerID="8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f" exitCode=0 Jul 06 19:32:07.532625 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.532161 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d58b4ddff-2wmbr" Jul 06 19:32:07.532625 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.532164 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d58b4ddff-2wmbr" event={"ID":"8a42691a-6a03-4933-a555-0ef0e0124371","Type":"ContainerDied","Data":"8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f"} Jul 06 19:32:07.532625 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.532289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d58b4ddff-2wmbr" event={"ID":"8a42691a-6a03-4933-a555-0ef0e0124371","Type":"ContainerDied","Data":"d8d51413cb399b90a7e0a50df8468dda20e8698e3ce41dae2386b1d77376d5bb"} Jul 06 19:32:07.532625 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.532316 2555 scope.go:117] "RemoveContainer" containerID="8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f" Jul 06 19:32:07.540360 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.540343 2555 scope.go:117] "RemoveContainer" containerID="8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f" Jul 06 19:32:07.540678 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:32:07.540662 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f\": container with ID starting with 8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f not found: ID does not exist" containerID="8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f" Jul 06 19:32:07.540739 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.540685 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f"} err="failed to get container status \"8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f\": rpc error: code = NotFound desc = could not find container \"8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f\": container with ID starting with 8a99ddf83d1ae885f6c4d59069ff9c198f490d7d56ac1f31b63f5d06a14ea28f not found: ID does not exist" Jul 06 19:32:07.554382 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.554357 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d58b4ddff-2wmbr"] Jul 06 19:32:07.558747 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.558723 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d58b4ddff-2wmbr"] Jul 06 19:32:07.849193 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:07.849102 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a42691a-6a03-4933-a555-0ef0e0124371" path="/var/lib/kubelet/pods/8a42691a-6a03-4933-a555-0ef0e0124371/volumes" Jul 06 19:32:27.605942 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:27.605903 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:32:27.626139 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:27.626114 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:32:28.628911 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:32:28.628886 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:33:05.725921 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.725843 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb67f64b5-j7x5n"] Jul 06 19:33:05.726362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.726120 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a42691a-6a03-4933-a555-0ef0e0124371" containerName="console" Jul 06 19:33:05.726362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.726131 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a42691a-6a03-4933-a555-0ef0e0124371" containerName="console" Jul 06 19:33:05.726362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.726190 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a42691a-6a03-4933-a555-0ef0e0124371" containerName="console" Jul 06 19:33:05.728099 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.728081 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.742275 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.742237 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb67f64b5-j7x5n"] Jul 06 19:33:05.816927 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.816882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-oauth-config\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.816927 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.816926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-oauth-serving-cert\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.817133 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.816955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-serving-cert\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.817133 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.817035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-service-ca\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.817133 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.817066 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-trusted-ca-bundle\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.817133 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.817100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl2n6\" (UniqueName: \"kubernetes.io/projected/867766dd-f4e3-4881-a759-bf604862d15a-kube-api-access-pl2n6\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.817271 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.817135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-console-config\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.917706 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-console-config\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.917872 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-oauth-config\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.917872 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-oauth-serving-cert\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.917872 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-serving-cert\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.917872 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917823 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-service-ca\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.917872 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-trusted-ca-bundle\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.918061 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.917897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl2n6\" (UniqueName: \"kubernetes.io/projected/867766dd-f4e3-4881-a759-bf604862d15a-kube-api-access-pl2n6\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.918582 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.918553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-console-config\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.918702 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.918655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-oauth-serving-cert\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.918885 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.918862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-service-ca\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.918922 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.918902 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-trusted-ca-bundle\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.920234 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.920205 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-oauth-config\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.920346 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.920326 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-serving-cert\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:05.926150 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:05.926129 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl2n6\" (UniqueName: \"kubernetes.io/projected/867766dd-f4e3-4881-a759-bf604862d15a-kube-api-access-pl2n6\") pod \"console-5cb67f64b5-j7x5n\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:06.036871 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:06.036840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:06.163822 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:06.163785 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb67f64b5-j7x5n"] Jul 06 19:33:06.166514 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:33:06.166482 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867766dd_f4e3_4881_a759_bf604862d15a.slice/crio-f13964691234798cf28998c9f5e077206fc9aebd334d1a0ed0a8dbaae18ef345 WatchSource:0}: Error finding container f13964691234798cf28998c9f5e077206fc9aebd334d1a0ed0a8dbaae18ef345: Status 404 returned error can't find the container with id f13964691234798cf28998c9f5e077206fc9aebd334d1a0ed0a8dbaae18ef345 Jul 06 19:33:06.758616 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:06.758576 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb67f64b5-j7x5n" event={"ID":"867766dd-f4e3-4881-a759-bf604862d15a","Type":"ContainerStarted","Data":"2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037"} Jul 06 19:33:06.758981 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:06.758627 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb67f64b5-j7x5n" event={"ID":"867766dd-f4e3-4881-a759-bf604862d15a","Type":"ContainerStarted","Data":"f13964691234798cf28998c9f5e077206fc9aebd334d1a0ed0a8dbaae18ef345"} Jul 06 19:33:06.778275 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:06.778225 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb67f64b5-j7x5n" podStartSLOduration=1.778210916 podStartE2EDuration="1.778210916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:06.776802837 +0000 UTC m=+476.654941566" watchObservedRunningTime="2026-07-06 19:33:06.778210916 +0000 UTC m=+476.656349644" Jul 06 19:33:16.037308 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:16.037272 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:16.037791 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:16.037329 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:16.042163 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:16.042142 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:16.799814 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:16.799786 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 19:33:16.862126 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:16.862095 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc44bbf7-c2lqr"] Jul 06 19:33:41.886661 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:41.886615 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fc44bbf7-c2lqr" podUID="60076f0c-4f36-4f85-bd6a-49cce060bad9" containerName="console" containerID="cri-o://03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e" gracePeriod=15 Jul 06 19:33:42.129252 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.129225 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:33:42.220506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220420 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-config\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220471 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84tvn\" (UniqueName: \"kubernetes.io/projected/60076f0c-4f36-4f85-bd6a-49cce060bad9-kube-api-access-84tvn\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220501 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-service-ca\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220727 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220535 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-trusted-ca-bundle\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220799 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220778 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-serving-cert\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220848 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220822 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-oauth-serving-cert\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220893 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220866 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-oauth-config\") pod \"60076f0c-4f36-4f85-bd6a-49cce060bad9\" (UID: \"60076f0c-4f36-4f85-bd6a-49cce060bad9\") " Jul 06 19:33:42.220893 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220878 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-config" (OuterVolumeSpecName: "console-config") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:33:42.220995 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220923 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-service-ca" (OuterVolumeSpecName: "service-ca") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:33:42.220995 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.220947 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:33:42.221247 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.221227 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.221334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.221254 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.221334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.221268 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-trusted-ca-bundle\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.221334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.221229 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:33:42.222767 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.222746 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60076f0c-4f36-4f85-bd6a-49cce060bad9-kube-api-access-84tvn" (OuterVolumeSpecName: "kube-api-access-84tvn") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "kube-api-access-84tvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:42.222850 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.222823 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:33:42.222946 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.222883 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "60076f0c-4f36-4f85-bd6a-49cce060bad9" (UID: "60076f0c-4f36-4f85-bd6a-49cce060bad9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:33:42.322174 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.322145 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-oauth-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.322174 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.322170 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84tvn\" (UniqueName: \"kubernetes.io/projected/60076f0c-4f36-4f85-bd6a-49cce060bad9-kube-api-access-84tvn\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.322174 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.322181 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60076f0c-4f36-4f85-bd6a-49cce060bad9-console-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.322383 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.322189 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60076f0c-4f36-4f85-bd6a-49cce060bad9-oauth-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:33:42.892689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.892651 2555 generic.go:356] "Generic (PLEG): container finished" podID="60076f0c-4f36-4f85-bd6a-49cce060bad9" containerID="03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e" exitCode=0 Jul 06 19:33:42.893079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.892698 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc44bbf7-c2lqr" Jul 06 19:33:42.893079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.892733 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc44bbf7-c2lqr" event={"ID":"60076f0c-4f36-4f85-bd6a-49cce060bad9","Type":"ContainerDied","Data":"03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e"} Jul 06 19:33:42.893079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.892781 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc44bbf7-c2lqr" event={"ID":"60076f0c-4f36-4f85-bd6a-49cce060bad9","Type":"ContainerDied","Data":"5c7d0274c8f25ee1470404ae76f5e346de17fce7f0bba30e76e61bf086d5c81a"} Jul 06 19:33:42.893079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.892799 2555 scope.go:117] "RemoveContainer" containerID="03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e" Jul 06 19:33:42.901163 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.901147 2555 scope.go:117] "RemoveContainer" containerID="03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e" Jul 06 19:33:42.901444 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:33:42.901420 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e\": container with ID starting with 03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e not found: ID does not exist" containerID="03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e" Jul 06 19:33:42.901495 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.901457 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e"} err="failed to get container status \"03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e\": rpc error: code = NotFound desc = could not find container \"03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e\": container with ID starting with 03cc84d0be42155f74fa68f7909079708f55fb4fac8991f47156f693fa75833e not found: ID does not exist" Jul 06 19:33:42.913203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.913172 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc44bbf7-c2lqr"] Jul 06 19:33:42.917427 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:42.917408 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fc44bbf7-c2lqr"] Jul 06 19:33:43.849751 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:33:43.849718 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60076f0c-4f36-4f85-bd6a-49cce060bad9" path="/var/lib/kubelet/pods/60076f0c-4f36-4f85-bd6a-49cce060bad9/volumes" Jul 06 19:34:21.933517 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.933479 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t"] Jul 06 19:34:21.933958 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.933753 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60076f0c-4f36-4f85-bd6a-49cce060bad9" containerName="console" Jul 06 19:34:21.933958 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.933763 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="60076f0c-4f36-4f85-bd6a-49cce060bad9" containerName="console" Jul 06 19:34:21.933958 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.933812 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="60076f0c-4f36-4f85-bd6a-49cce060bad9" containerName="console" Jul 06 19:34:21.937895 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.937865 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:21.940252 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.940233 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-58mz8\"" Jul 06 19:34:21.940407 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.940270 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:34:21.940407 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.940292 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:34:21.950163 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:21.950145 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t"] Jul 06 19:34:22.038582 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.038550 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pff4t\" (UID: \"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.038766 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.038592 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbqhw\" (UniqueName: \"kubernetes.io/projected/2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8-kube-api-access-hbqhw\") pod \"openshift-lws-operator-fd8ccff4c-pff4t\" (UID: \"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.139281 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.139248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pff4t\" (UID: \"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.139472 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.139292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbqhw\" (UniqueName: \"kubernetes.io/projected/2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8-kube-api-access-hbqhw\") pod \"openshift-lws-operator-fd8ccff4c-pff4t\" (UID: \"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.139665 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.139647 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pff4t\" (UID: \"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.154300 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.154274 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbqhw\" (UniqueName: \"kubernetes.io/projected/2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8-kube-api-access-hbqhw\") pod \"openshift-lws-operator-fd8ccff4c-pff4t\" (UID: \"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.266377 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.266356 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" Jul 06 19:34:22.395238 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:22.395215 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t"] Jul 06 19:34:22.397486 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:34:22.397443 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bb7ad14_bd79_4cf5_b4e3_672aa6e27bf8.slice/crio-9b438e049aac06d211cfa7b1a9dd6bd73a3b6606664060119602b55eab38e8fb WatchSource:0}: Error finding container 9b438e049aac06d211cfa7b1a9dd6bd73a3b6606664060119602b55eab38e8fb: Status 404 returned error can't find the container with id 9b438e049aac06d211cfa7b1a9dd6bd73a3b6606664060119602b55eab38e8fb Jul 06 19:34:23.039227 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:23.039195 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" event={"ID":"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8","Type":"ContainerStarted","Data":"9b438e049aac06d211cfa7b1a9dd6bd73a3b6606664060119602b55eab38e8fb"} Jul 06 19:34:25.049362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:25.049320 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" event={"ID":"2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8","Type":"ContainerStarted","Data":"f3f2a38ef85ea394067815bb51d3195da825324a9ad2d6ce36985316153d3236"} Jul 06 19:34:25.065245 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:25.065186 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pff4t" podStartSLOduration=1.577570428 podStartE2EDuration="4.065166781s" totalImagesPullingTime="2.487596353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:25.064843817 +0000 UTC m=+554.942982546" watchObservedRunningTime="2026-07-06 19:34:25.065166781 +0000 UTC m=+554.943305512" Jul 06 19:34:44.926226 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.926191 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf"] Jul 06 19:34:44.929420 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.929403 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:44.932044 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.932018 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:34:44.932165 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.932058 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:34:44.932372 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.932358 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:34:44.932461 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.932437 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pk84c\"" Jul 06 19:34:44.933008 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.932995 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:34:44.939044 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.939014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-webhook-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:44.939157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.939049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq476\" (UniqueName: \"kubernetes.io/projected/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-kube-api-access-jq476\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:44.939157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.939076 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-tmp\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:44.939280 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.939178 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:44.939280 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.939211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-manifests\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:44.944175 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:44.944155 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf"] Jul 06 19:34:45.040140 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.040109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.040140 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.040144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-manifests\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.040349 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.040213 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-webhook-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.040349 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.040248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq476\" (UniqueName: \"kubernetes.io/projected/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-kube-api-access-jq476\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.040349 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.040278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-tmp\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.040663 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.040630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-manifests\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.042536 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.042509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-tmp\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.042845 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.042826 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-webhook-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.042845 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.042831 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.050145 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.050128 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq476\" (UniqueName: \"kubernetes.io/projected/193a5cc4-3b9e-411a-9b84-84d9f2971e5a-kube-api-access-jq476\") pod \"opendatahub-operator-controller-manager-849ccdb5-t5wvf\" (UID: \"193a5cc4-3b9e-411a-9b84-84d9f2971e5a\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.240335 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.240258 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:45.371877 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:45.371840 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf"] Jul 06 19:34:45.374617 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:34:45.374592 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193a5cc4_3b9e_411a_9b84_84d9f2971e5a.slice/crio-f87658ef7a1e4275e05a444008db086442b8ab60407acb7d9d8d6d640d3ec9d7 WatchSource:0}: Error finding container f87658ef7a1e4275e05a444008db086442b8ab60407acb7d9d8d6d640d3ec9d7: Status 404 returned error can't find the container with id f87658ef7a1e4275e05a444008db086442b8ab60407acb7d9d8d6d640d3ec9d7 Jul 06 19:34:46.130532 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:46.130491 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" event={"ID":"193a5cc4-3b9e-411a-9b84-84d9f2971e5a","Type":"ContainerStarted","Data":"f87658ef7a1e4275e05a444008db086442b8ab60407acb7d9d8d6d640d3ec9d7"} Jul 06 19:34:49.144308 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:49.144275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" event={"ID":"193a5cc4-3b9e-411a-9b84-84d9f2971e5a","Type":"ContainerStarted","Data":"c5d3fe9ac2234003e4d43c966b5ecd33891f737ba9d2a2d6ee9d17203d74e60a"} Jul 06 19:34:50.150713 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:50.150679 2555 generic.go:356] "Generic (PLEG): container finished" podID="193a5cc4-3b9e-411a-9b84-84d9f2971e5a" containerID="c5d3fe9ac2234003e4d43c966b5ecd33891f737ba9d2a2d6ee9d17203d74e60a" exitCode=0 Jul 06 19:34:50.151093 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:50.150755 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" event={"ID":"193a5cc4-3b9e-411a-9b84-84d9f2971e5a","Type":"ContainerDied","Data":"c5d3fe9ac2234003e4d43c966b5ecd33891f737ba9d2a2d6ee9d17203d74e60a"} Jul 06 19:34:51.156894 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:51.156861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" event={"ID":"193a5cc4-3b9e-411a-9b84-84d9f2971e5a","Type":"ContainerStarted","Data":"ba60ed52d6167fe9eb9d71c3409e3627f4f66615fa14b5b70253678e8231ed75"} Jul 06 19:34:51.157271 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:51.156995 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:34:51.199581 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:34:51.199531 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" podStartSLOduration=2.859910371 podStartE2EDuration="7.199514915s" totalImagesPullingTime="3.322207437s" totalInitContainerRuntime="1.017397107s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:51.197573564 +0000 UTC m=+581.075712291" watchObservedRunningTime="2026-07-06 19:34:51.199514915 +0000 UTC m=+581.077653643" Jul 06 19:35:02.163237 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:02.163207 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-t5wvf" Jul 06 19:35:04.588985 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.588948 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb"] Jul 06 19:35:04.592596 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.592572 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.598578 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.598548 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:35:04.598753 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.598559 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:35:04.599740 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.599716 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:35:04.599868 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.599765 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:35:04.599868 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.599776 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rtg6g\"" Jul 06 19:35:04.617438 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.617407 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb"] Jul 06 19:35:04.708631 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.708600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-tmp\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.708783 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.708686 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-tls-certs\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.708783 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.708721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdjc2\" (UniqueName: \"kubernetes.io/projected/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-kube-api-access-tdjc2\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.809979 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.809943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-tls-certs\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.810140 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.809992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdjc2\" (UniqueName: \"kubernetes.io/projected/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-kube-api-access-tdjc2\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.810140 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.810031 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-tmp\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.812356 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.812328 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-tmp\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.812585 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.812560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-tls-certs\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.831321 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.831296 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdjc2\" (UniqueName: \"kubernetes.io/projected/0e806e7e-3f5b-47d3-8ffc-7ce253c73c06-kube-api-access-tdjc2\") pod \"kube-auth-proxy-6568d8f747-bnsbb\" (UID: \"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:04.902889 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:04.902814 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" Jul 06 19:35:05.039333 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.039309 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb"] Jul 06 19:35:05.041594 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:35:05.041566 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e806e7e_3f5b_47d3_8ffc_7ce253c73c06.slice/crio-6cbec8650aa345128c8fd545fc6bded44cb0aa2789888739f7596656b59e4f5c WatchSource:0}: Error finding container 6cbec8650aa345128c8fd545fc6bded44cb0aa2789888739f7596656b59e4f5c: Status 404 returned error can't find the container with id 6cbec8650aa345128c8fd545fc6bded44cb0aa2789888739f7596656b59e4f5c Jul 06 19:35:05.214082 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.213995 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" event={"ID":"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06","Type":"ContainerStarted","Data":"6cbec8650aa345128c8fd545fc6bded44cb0aa2789888739f7596656b59e4f5c"} Jul 06 19:35:05.755142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.755106 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hfcvc"] Jul 06 19:35:05.759288 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.759261 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:05.762083 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.762056 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7csq4\"" Jul 06 19:35:05.762207 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.762190 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 19:35:05.769858 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.769834 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hfcvc"] Jul 06 19:35:05.818811 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.818670 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvchk\" (UniqueName: \"kubernetes.io/projected/33121619-7ae6-4faa-bcec-db6ac3d2349e-kube-api-access-kvchk\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:05.818811 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.818726 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:05.919890 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.919857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvchk\" (UniqueName: \"kubernetes.io/projected/33121619-7ae6-4faa-bcec-db6ac3d2349e-kube-api-access-kvchk\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:05.919890 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.919892 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:05.920109 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:35:05.920025 2555 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 19:35:05.920109 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:35:05.920084 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs podName:33121619-7ae6-4faa-bcec-db6ac3d2349e nodeName:}" failed. No retries permitted until 2026-07-06 19:35:06.420067873 +0000 UTC m=+596.298206578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs") pod "model-serving-api-54d89bd5fc-hfcvc" (UID: "33121619-7ae6-4faa-bcec-db6ac3d2349e") : secret "model-serving-api-tls" not found Jul 06 19:35:05.956442 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:05.956410 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvchk\" (UniqueName: \"kubernetes.io/projected/33121619-7ae6-4faa-bcec-db6ac3d2349e-kube-api-access-kvchk\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:06.425470 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:06.425432 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:06.425643 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:35:06.425596 2555 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 19:35:06.425702 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:35:06.425664 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs podName:33121619-7ae6-4faa-bcec-db6ac3d2349e nodeName:}" failed. No retries permitted until 2026-07-06 19:35:07.425645606 +0000 UTC m=+597.303784336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs") pod "model-serving-api-54d89bd5fc-hfcvc" (UID: "33121619-7ae6-4faa-bcec-db6ac3d2349e") : secret "model-serving-api-tls" not found Jul 06 19:35:07.436248 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:07.436212 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:07.438876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:07.438851 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33121619-7ae6-4faa-bcec-db6ac3d2349e-tls-certs\") pod \"model-serving-api-54d89bd5fc-hfcvc\" (UID: \"33121619-7ae6-4faa-bcec-db6ac3d2349e\") " pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:07.573171 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:07.573133 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:07.738322 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:07.738288 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hfcvc"] Jul 06 19:35:07.741645 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:35:07.741616 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33121619_7ae6_4faa_bcec_db6ac3d2349e.slice/crio-12b4417ad72e21c63bc9d27c8cd314bea94fbb899cbb7e5bacfd71618128588f WatchSource:0}: Error finding container 12b4417ad72e21c63bc9d27c8cd314bea94fbb899cbb7e5bacfd71618128588f: Status 404 returned error can't find the container with id 12b4417ad72e21c63bc9d27c8cd314bea94fbb899cbb7e5bacfd71618128588f Jul 06 19:35:08.230520 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:08.230485 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" event={"ID":"0e806e7e-3f5b-47d3-8ffc-7ce253c73c06","Type":"ContainerStarted","Data":"f7eb92e16625445d79e46e3185e597e18da96e69b4964abf110b2f1d0b760d4e"} Jul 06 19:35:08.231830 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:08.231797 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" event={"ID":"33121619-7ae6-4faa-bcec-db6ac3d2349e","Type":"ContainerStarted","Data":"12b4417ad72e21c63bc9d27c8cd314bea94fbb899cbb7e5bacfd71618128588f"} Jul 06 19:35:08.249341 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:08.249292 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6568d8f747-bnsbb" podStartSLOduration=1.677022348 podStartE2EDuration="4.249274676s" totalImagesPullingTime="2.572252328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:08.247463372 +0000 UTC m=+598.125602128" watchObservedRunningTime="2026-07-06 19:35:08.249274676 +0000 UTC m=+598.127413406" Jul 06 19:35:09.246170 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:09.246136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" event={"ID":"33121619-7ae6-4faa-bcec-db6ac3d2349e","Type":"ContainerStarted","Data":"864d7759f98aebabaeae63e600a559c152f77d157c8dbdae40a2cbafc5b7212b"} Jul 06 19:35:09.246545 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:09.246322 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:09.265909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:09.265870 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" podStartSLOduration=2.845856426 podStartE2EDuration="4.265856116s" totalImagesPullingTime="1.41999969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:09.264586265 +0000 UTC m=+599.142724993" watchObservedRunningTime="2026-07-06 19:35:09.265856116 +0000 UTC m=+599.143994868" Jul 06 19:35:11.513823 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.513788 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t"] Jul 06 19:35:11.517136 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.517120 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.520777 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.520752 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:35:11.521018 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.521002 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x6q4s\"" Jul 06 19:35:11.538488 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.538467 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t"] Jul 06 19:35:11.672898 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.672862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673068 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.672905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673068 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.672952 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acaf70bc-025f-4986-b88d-9a06666937e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673068 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.673030 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acaf70bc-025f-4986-b88d-9a06666937e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673256 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.673073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673256 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.673104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673256 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.673140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgs2b\" (UniqueName: \"kubernetes.io/projected/acaf70bc-025f-4986-b88d-9a06666937e2-kube-api-access-sgs2b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673256 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.673228 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acaf70bc-025f-4986-b88d-9a06666937e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.673414 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.673287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774283 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774213 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acaf70bc-025f-4986-b88d-9a06666937e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774283 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774257 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgs2b\" (UniqueName: \"kubernetes.io/projected/acaf70bc-025f-4986-b88d-9a06666937e2-kube-api-access-sgs2b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774360 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acaf70bc-025f-4986-b88d-9a06666937e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774423 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774459 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774768 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774768 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acaf70bc-025f-4986-b88d-9a06666937e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774768 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774768 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774732 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774933 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774842 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.774933 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.774876 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.776479 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.776442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acaf70bc-025f-4986-b88d-9a06666937e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.776706 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.776689 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:35:11.776865 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.776847 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acaf70bc-025f-4986-b88d-9a06666937e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.785160 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.785140 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acaf70bc-025f-4986-b88d-9a06666937e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.788277 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.788259 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgs2b\" (UniqueName: \"kubernetes.io/projected/acaf70bc-025f-4986-b88d-9a06666937e2-kube-api-access-sgs2b\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.788384 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.788322 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acaf70bc-025f-4986-b88d-9a06666937e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xsh9t\" (UID: \"acaf70bc-025f-4986-b88d-9a06666937e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.829201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.829172 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x6q4s\"" Jul 06 19:35:11.837018 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.837003 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:11.971474 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:11.971441 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t"] Jul 06 19:35:11.974732 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:35:11.974704 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacaf70bc_025f_4986_b88d_9a06666937e2.slice/crio-ef4b64e953e4941a4bf247a1b5df527b504b801c8e3af8782c443431c7de44d5 WatchSource:0}: Error finding container ef4b64e953e4941a4bf247a1b5df527b504b801c8e3af8782c443431c7de44d5: Status 404 returned error can't find the container with id ef4b64e953e4941a4bf247a1b5df527b504b801c8e3af8782c443431c7de44d5 Jul 06 19:35:12.258934 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:12.258897 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" event={"ID":"acaf70bc-025f-4986-b88d-9a06666937e2","Type":"ContainerStarted","Data":"ef4b64e953e4941a4bf247a1b5df527b504b801c8e3af8782c443431c7de44d5"} Jul 06 19:35:14.113251 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.113216 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc"] Jul 06 19:35:14.120177 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.120156 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.123271 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.123239 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:35:14.123456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.123308 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xlll2\"" Jul 06 19:35:14.123456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.123239 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:35:14.123456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.123239 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:35:14.139518 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.138104 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc"] Jul 06 19:35:14.202522 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.202489 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ce8cad2-c6dd-40e1-b175-b641419c1665-manager-config\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.202671 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.202551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ce8cad2-c6dd-40e1-b175-b641419c1665-cert\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.202671 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.202600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b58sc\" (UniqueName: \"kubernetes.io/projected/9ce8cad2-c6dd-40e1-b175-b641419c1665-kube-api-access-b58sc\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.202671 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.202631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ce8cad2-c6dd-40e1-b175-b641419c1665-metrics-cert\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.304138 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.304102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ce8cad2-c6dd-40e1-b175-b641419c1665-manager-config\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.304138 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.304165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ce8cad2-c6dd-40e1-b175-b641419c1665-cert\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.304453 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.304193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b58sc\" (UniqueName: \"kubernetes.io/projected/9ce8cad2-c6dd-40e1-b175-b641419c1665-kube-api-access-b58sc\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.304453 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.304221 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ce8cad2-c6dd-40e1-b175-b641419c1665-metrics-cert\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.305086 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.305037 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9ce8cad2-c6dd-40e1-b175-b641419c1665-manager-config\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.307029 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.306964 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ce8cad2-c6dd-40e1-b175-b641419c1665-cert\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.307029 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.306969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ce8cad2-c6dd-40e1-b175-b641419c1665-metrics-cert\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.330804 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.330758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b58sc\" (UniqueName: \"kubernetes.io/projected/9ce8cad2-c6dd-40e1-b175-b641419c1665-kube-api-access-b58sc\") pod \"lws-controller-manager-67bb7fcf7f-knrgc\" (UID: \"9ce8cad2-c6dd-40e1-b175-b641419c1665\") " pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:14.431482 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:14.431358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:15.104454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.104384 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:35:15.104546 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.104516 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:35:15.104603 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.104550 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:35:15.186241 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.186215 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc"] Jul 06 19:35:15.188322 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:35:15.188296 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce8cad2_c6dd_40e1_b175_b641419c1665.slice/crio-8bda5c4d550b94d03b559bf66bd8bd9ba13172f15ff98ab9ff5f70fc87db780e WatchSource:0}: Error finding container 8bda5c4d550b94d03b559bf66bd8bd9ba13172f15ff98ab9ff5f70fc87db780e: Status 404 returned error can't find the container with id 8bda5c4d550b94d03b559bf66bd8bd9ba13172f15ff98ab9ff5f70fc87db780e Jul 06 19:35:15.276018 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.275978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" event={"ID":"acaf70bc-025f-4986-b88d-9a06666937e2","Type":"ContainerStarted","Data":"a3e1767df9469a299b38225ddf5f7b98983802f82f8b87408bdb51e4c0be20d4"} Jul 06 19:35:15.277266 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.277242 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" event={"ID":"9ce8cad2-c6dd-40e1-b175-b641419c1665","Type":"ContainerStarted","Data":"8bda5c4d550b94d03b559bf66bd8bd9ba13172f15ff98ab9ff5f70fc87db780e"} Jul 06 19:35:15.312465 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.308849 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" podStartSLOduration=1.181690801 podStartE2EDuration="4.308829338s" totalImagesPullingTime="3.127138537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:15.30806166 +0000 UTC m=+605.186200392" watchObservedRunningTime="2026-07-06 19:35:15.308829338 +0000 UTC m=+605.186968067" Jul 06 19:35:15.837574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:15.837542 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:16.842269 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:16.842241 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:17.294230 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:17.294191 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" event={"ID":"9ce8cad2-c6dd-40e1-b175-b641419c1665","Type":"ContainerStarted","Data":"b63b230c20a1a02b5193b8e3df8b93b6b5fcbdc30db2e4fa7e548a3f651cceef"} Jul 06 19:35:17.294447 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:17.294280 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:17.294590 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:17.294575 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:35:17.295260 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:17.295237 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xsh9t" Jul 06 19:35:17.317579 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:17.317535 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" podStartSLOduration=1.779250783 podStartE2EDuration="3.317522834s" totalImagesPullingTime="1.538272051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:17.315634345 +0000 UTC m=+607.193773067" watchObservedRunningTime="2026-07-06 19:35:17.317522834 +0000 UTC m=+607.195661562" Jul 06 19:35:20.254526 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:20.254472 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hfcvc" Jul 06 19:35:28.301339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:35:28.301307 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 19:36:51.624761 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.624725 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-669ww"] Jul 06 19:36:51.627967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.627950 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.630372 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.630348 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 19:36:51.630506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.630349 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 19:36:51.630506 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.630357 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:36:51.631259 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.631242 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:36:51.631315 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.631249 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-229dl\"" Jul 06 19:36:51.636846 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.636826 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-669ww"] Jul 06 19:36:51.754071 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.754038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166a6508-5fb9-4ad9-9f2c-ec448e18295e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.754234 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.754095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/166a6508-5fb9-4ad9-9f2c-ec448e18295e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.754234 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.754114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5p9\" (UniqueName: \"kubernetes.io/projected/166a6508-5fb9-4ad9-9f2c-ec448e18295e-kube-api-access-ps5p9\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.854681 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.854651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166a6508-5fb9-4ad9-9f2c-ec448e18295e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.854875 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.854728 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/166a6508-5fb9-4ad9-9f2c-ec448e18295e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.854875 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.854753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5p9\" (UniqueName: \"kubernetes.io/projected/166a6508-5fb9-4ad9-9f2c-ec448e18295e-kube-api-access-ps5p9\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.855569 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.855542 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/166a6508-5fb9-4ad9-9f2c-ec448e18295e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.857419 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.857383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/166a6508-5fb9-4ad9-9f2c-ec448e18295e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.870135 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.870102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5p9\" (UniqueName: \"kubernetes.io/projected/166a6508-5fb9-4ad9-9f2c-ec448e18295e-kube-api-access-ps5p9\") pod \"kuadrant-console-plugin-66b5774985-669ww\" (UID: \"166a6508-5fb9-4ad9-9f2c-ec448e18295e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:51.938684 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:51.938595 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" Jul 06 19:36:52.062579 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:52.062558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-669ww"] Jul 06 19:36:52.064704 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:36:52.064678 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod166a6508_5fb9_4ad9_9f2c_ec448e18295e.slice/crio-66e884756a94d228c38cb4a8d94095696ea31c904be11a8b32913e3ae944c1c0 WatchSource:0}: Error finding container 66e884756a94d228c38cb4a8d94095696ea31c904be11a8b32913e3ae944c1c0: Status 404 returned error can't find the container with id 66e884756a94d228c38cb4a8d94095696ea31c904be11a8b32913e3ae944c1c0 Jul 06 19:36:52.065881 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:52.065863 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:36:52.706587 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:36:52.706551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" event={"ID":"166a6508-5fb9-4ad9-9f2c-ec448e18295e","Type":"ContainerStarted","Data":"66e884756a94d228c38cb4a8d94095696ea31c904be11a8b32913e3ae944c1c0"} Jul 06 19:37:15.820986 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:15.820948 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" event={"ID":"166a6508-5fb9-4ad9-9f2c-ec448e18295e","Type":"ContainerStarted","Data":"906077ca477b910a00b58094f799fef24c994a7eb04e2c75b32abb83c1df01d6"} Jul 06 19:37:15.846621 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:15.846560 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-669ww" podStartSLOduration=2.030600006 podStartE2EDuration="24.846540182s" totalImagesPullingTime="22.815940176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:15.845380408 +0000 UTC m=+725.723519137" watchObservedRunningTime="2026-07-06 19:37:15.846540182 +0000 UTC m=+725.724678915" Jul 06 19:37:30.969840 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:30.969810 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl"] Jul 06 19:37:30.989017 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:30.988989 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl"] Jul 06 19:37:30.989175 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:30.989101 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:30.991369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:30.991350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8kz68\"" Jul 06 19:37:31.125195 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f80d29e4-e535-4241-bb6d-a6a375c11536-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125195 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmnt\" (UniqueName: \"kubernetes.io/projected/f80d29e4-e535-4241-bb6d-a6a375c11536-kube-api-access-flmnt\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.125454 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.125456 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226433 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226339 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f80d29e4-e535-4241-bb6d-a6a375c11536-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226433 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226433 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226416 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmnt\" (UniqueName: \"kubernetes.io/projected/f80d29e4-e535-4241-bb6d-a6a375c11536-kube-api-access-flmnt\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226475 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226643 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226746 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226813 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.226909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.226870 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.227352 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.227324 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.227555 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.227504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f80d29e4-e535-4241-bb6d-a6a375c11536-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.227789 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.227765 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.230283 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.230261 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.231670 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.231644 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.235466 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.235446 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80d29e4-e535-4241-bb6d-a6a375c11536-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.235967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.235949 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmnt\" (UniqueName: \"kubernetes.io/projected/f80d29e4-e535-4241-bb6d-a6a375c11536-kube-api-access-flmnt\") pod \"maas-default-gateway-openshift-default-56654dcf7-mrpwl\" (UID: \"f80d29e4-e535-4241-bb6d-a6a375c11536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.299757 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.299727 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:31.427336 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.427309 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl"] Jul 06 19:37:31.429465 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:37:31.429439 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80d29e4_e535_4241_bb6d_a6a375c11536.slice/crio-c5c64c6eb87391edfaa10bc788799856b2ebfc3e7f1da0f5f748936f79f75b26 WatchSource:0}: Error finding container c5c64c6eb87391edfaa10bc788799856b2ebfc3e7f1da0f5f748936f79f75b26: Status 404 returned error can't find the container with id c5c64c6eb87391edfaa10bc788799856b2ebfc3e7f1da0f5f748936f79f75b26 Jul 06 19:37:31.431994 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.431961 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:37:31.432055 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.432037 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:37:31.432095 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.432078 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:37:31.888812 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.888776 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" event={"ID":"f80d29e4-e535-4241-bb6d-a6a375c11536","Type":"ContainerStarted","Data":"764988e22b081c668a3810a9e763872397d247d64b1455fd6e577f66807c9382"} Jul 06 19:37:31.889007 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.888824 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" event={"ID":"f80d29e4-e535-4241-bb6d-a6a375c11536","Type":"ContainerStarted","Data":"c5c64c6eb87391edfaa10bc788799856b2ebfc3e7f1da0f5f748936f79f75b26"} Jul 06 19:37:31.911465 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:31.911412 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" podStartSLOduration=1.9113750619999998 podStartE2EDuration="1.911375062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:31.910422984 +0000 UTC m=+741.788561714" watchObservedRunningTime="2026-07-06 19:37:31.911375062 +0000 UTC m=+741.789513849" Jul 06 19:37:32.300793 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:32.300766 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:32.304828 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:32.304808 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:32.893465 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:32.893437 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:32.894404 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:32.894364 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:37:45.213495 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.213466 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:37:45.241811 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.241784 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:37:45.241948 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.241874 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.244613 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.244586 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 19:37:45.277656 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.277629 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:37:45.347056 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.347028 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vt2\" (UniqueName: \"kubernetes.io/projected/63c951c8-1e88-4d91-8416-33b0be2d4100-kube-api-access-j7vt2\") pod \"limitador-limitador-54d6d988d5-vrdcn\" (UID: \"63c951c8-1e88-4d91-8416-33b0be2d4100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.347195 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.347062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c951c8-1e88-4d91-8416-33b0be2d4100-config-file\") pod \"limitador-limitador-54d6d988d5-vrdcn\" (UID: \"63c951c8-1e88-4d91-8416-33b0be2d4100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.448229 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.448192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vt2\" (UniqueName: \"kubernetes.io/projected/63c951c8-1e88-4d91-8416-33b0be2d4100-kube-api-access-j7vt2\") pod \"limitador-limitador-54d6d988d5-vrdcn\" (UID: \"63c951c8-1e88-4d91-8416-33b0be2d4100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.448229 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.448233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c951c8-1e88-4d91-8416-33b0be2d4100-config-file\") pod \"limitador-limitador-54d6d988d5-vrdcn\" (UID: \"63c951c8-1e88-4d91-8416-33b0be2d4100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.448839 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.448821 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/63c951c8-1e88-4d91-8416-33b0be2d4100-config-file\") pod \"limitador-limitador-54d6d988d5-vrdcn\" (UID: \"63c951c8-1e88-4d91-8416-33b0be2d4100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.458312 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.458293 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vt2\" (UniqueName: \"kubernetes.io/projected/63c951c8-1e88-4d91-8416-33b0be2d4100-kube-api-access-j7vt2\") pod \"limitador-limitador-54d6d988d5-vrdcn\" (UID: \"63c951c8-1e88-4d91-8416-33b0be2d4100\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.551931 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.551910 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:45.690439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.690416 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:37:45.692638 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:37:45.692608 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c951c8_1e88_4d91_8416_33b0be2d4100.slice/crio-34f2b31b31453d11b6bdd83dbf61e772ec115d8ce1bd46a2b908839c6af15987 WatchSource:0}: Error finding container 34f2b31b31453d11b6bdd83dbf61e772ec115d8ce1bd46a2b908839c6af15987: Status 404 returned error can't find the container with id 34f2b31b31453d11b6bdd83dbf61e772ec115d8ce1bd46a2b908839c6af15987 Jul 06 19:37:45.947818 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:45.947739 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" event={"ID":"63c951c8-1e88-4d91-8416-33b0be2d4100","Type":"ContainerStarted","Data":"34f2b31b31453d11b6bdd83dbf61e772ec115d8ce1bd46a2b908839c6af15987"} Jul 06 19:37:48.967162 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:48.967127 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" event={"ID":"63c951c8-1e88-4d91-8416-33b0be2d4100","Type":"ContainerStarted","Data":"2b1cdfc65148f6d4d15d9dd27a8f684f75b014deb9acd0fb7f99000b7ff5c768"} Jul 06 19:37:48.967577 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:48.967268 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:37:48.986571 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:48.986523 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" podStartSLOduration=1.3842333 podStartE2EDuration="3.986510607s" totalImagesPullingTime="2.602277307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:48.983999269 +0000 UTC m=+758.862137998" watchObservedRunningTime="2026-07-06 19:37:48.986510607 +0000 UTC m=+758.864649335" Jul 06 19:37:59.973544 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:37:59.973514 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vrdcn" Jul 06 19:38:59.285342 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:38:59.285246 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:39:07.312870 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:07.312833 2555 generic.go:356] "Generic (PLEG): container finished" podID="f80d29e4-e535-4241-bb6d-a6a375c11536" containerID="764988e22b081c668a3810a9e763872397d247d64b1455fd6e577f66807c9382" exitCode=0 Jul 06 19:39:07.313293 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:07.312905 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" event={"ID":"f80d29e4-e535-4241-bb6d-a6a375c11536","Type":"ContainerDied","Data":"764988e22b081c668a3810a9e763872397d247d64b1455fd6e577f66807c9382"} Jul 06 19:39:07.313293 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:07.313283 2555 scope.go:117] "RemoveContainer" containerID="764988e22b081c668a3810a9e763872397d247d64b1455fd6e577f66807c9382" Jul 06 19:39:07.314201 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:07.314178 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:39:07.314254 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:07.314243 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:39:07.314289 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:07.314273 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:39:08.319032 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:08.318998 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" event={"ID":"f80d29e4-e535-4241-bb6d-a6a375c11536","Type":"ContainerStarted","Data":"110510b4e3062d4ed43426620a4b5cc16b8b29f395eaa5e9071f9f5037ee2e61"} Jul 06 19:39:09.300275 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:09.300235 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:39:09.300487 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:09.300463 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mrpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 06 19:39:09.300535 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:09.300514 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" podUID="f80d29e4-e535-4241-bb6d-a6a375c11536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 06 19:39:10.300223 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:10.300185 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mrpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 06 19:39:10.300693 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:10.300243 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" podUID="f80d29e4-e535-4241-bb6d-a6a375c11536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 06 19:39:11.300094 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:11.300058 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mrpwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 06 19:39:11.300267 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:11.300110 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" podUID="f80d29e4-e535-4241-bb6d-a6a375c11536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 06 19:39:12.303889 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:12.303856 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:39:12.304373 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:12.304113 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:39:12.304740 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:12.304726 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mrpwl" Jul 06 19:39:25.809916 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:25.809882 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:39:39.998033 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:39.997996 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:39:51.998216 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:39:51.998181 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:40:06.995929 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:40:06.995849 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:40:12.401295 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:40:12.401251 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:40:21.088014 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:40:21.087975 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:42:07.509371 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:42:07.509292 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:42:16.396212 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:42:16.396176 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:42:28.307191 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:42:28.307160 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:42:36.796508 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:42:36.796469 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:42:47.595586 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:42:47.595553 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:44:04.997362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:44:04.997324 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:44:13.907071 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:44:13.907039 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:44:23.991369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:44:23.991318 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:44:29.400345 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:44:29.400302 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:44:40.990271 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:44:40.990194 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:44:51.307189 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:44:51.307154 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:45:00.173563 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:00.173525 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-l4w4m"] Jul 06 19:45:00.176167 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:00.176152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:00.178852 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:45:00.178822 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-29722785-l4w4m\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="8d66c115-54a1-44a4-9f86-c3821376fdd0" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:00.179099 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:45:00.179079 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-dockercfg-bt2cj\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bt2cj\"" type="*v1.Secret" Jul 06 19:45:00.216339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:00.216309 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-l4w4m"] Jul 06 19:45:00.253415 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:00.253355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7xc\" (UniqueName: \"kubernetes.io/projected/8d66c115-54a1-44a4-9f86-c3821376fdd0-kube-api-access-6k7xc\") pod \"maas-api-key-cleanup-29722785-l4w4m\" (UID: \"8d66c115-54a1-44a4-9f86-c3821376fdd0\") " pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:00.354481 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:00.354441 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7xc\" (UniqueName: \"kubernetes.io/projected/8d66c115-54a1-44a4-9f86-c3821376fdd0-kube-api-access-6k7xc\") pod \"maas-api-key-cleanup-29722785-l4w4m\" (UID: \"8d66c115-54a1-44a4-9f86-c3821376fdd0\") " pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:00.363822 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:00.363787 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7xc\" (UniqueName: \"kubernetes.io/projected/8d66c115-54a1-44a4-9f86-c3821376fdd0-kube-api-access-6k7xc\") pod \"maas-api-key-cleanup-29722785-l4w4m\" (UID: \"8d66c115-54a1-44a4-9f86-c3821376fdd0\") " pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:01.211969 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:01.211938 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bt2cj\"" Jul 06 19:45:01.216900 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:01.216879 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:01.341786 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:01.341699 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-l4w4m"] Jul 06 19:45:01.344535 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:45:01.344510 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d66c115_54a1_44a4_9f86_c3821376fdd0.slice/crio-d5f3a81346a1c4371a0b10da92f4ae49a00d2aab84d0704e522e4838e8fcc3ca WatchSource:0}: Error finding container d5f3a81346a1c4371a0b10da92f4ae49a00d2aab84d0704e522e4838e8fcc3ca: Status 404 returned error can't find the container with id d5f3a81346a1c4371a0b10da92f4ae49a00d2aab84d0704e522e4838e8fcc3ca Jul 06 19:45:01.346665 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:01.346649 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:45:01.890551 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:01.890519 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" event={"ID":"8d66c115-54a1-44a4-9f86-c3821376fdd0","Type":"ContainerStarted","Data":"d5f3a81346a1c4371a0b10da92f4ae49a00d2aab84d0704e522e4838e8fcc3ca"} Jul 06 19:45:03.298714 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:03.298680 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:45:03.902716 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:03.902684 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" event={"ID":"8d66c115-54a1-44a4-9f86-c3821376fdd0","Type":"ContainerStarted","Data":"aead1007ff6ed3d402a8268c2792efc7323bfbb5eb24f0ebe752b49c6bb4ceef"} Jul 06 19:45:03.919737 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:03.919691 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" podStartSLOduration=2.105186169 podStartE2EDuration="3.919676711s" totalImagesPullingTime="1.814490542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.919237066 +0000 UTC m=+1193.797375797" watchObservedRunningTime="2026-07-06 19:45:03.919676711 +0000 UTC m=+1193.797815438" Jul 06 19:45:04.909487 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:04.909451 2555 generic.go:356] "Generic (PLEG): container finished" podID="8d66c115-54a1-44a4-9f86-c3821376fdd0" containerID="aead1007ff6ed3d402a8268c2792efc7323bfbb5eb24f0ebe752b49c6bb4ceef" exitCode=0 Jul 06 19:45:04.909873 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:04.909548 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" event={"ID":"8d66c115-54a1-44a4-9f86-c3821376fdd0","Type":"ContainerDied","Data":"aead1007ff6ed3d402a8268c2792efc7323bfbb5eb24f0ebe752b49c6bb4ceef"} Jul 06 19:45:06.035191 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.035167 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:06.105685 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.105648 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k7xc\" (UniqueName: \"kubernetes.io/projected/8d66c115-54a1-44a4-9f86-c3821376fdd0-kube-api-access-6k7xc\") pod \"8d66c115-54a1-44a4-9f86-c3821376fdd0\" (UID: \"8d66c115-54a1-44a4-9f86-c3821376fdd0\") " Jul 06 19:45:06.107824 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.107802 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d66c115-54a1-44a4-9f86-c3821376fdd0-kube-api-access-6k7xc" (OuterVolumeSpecName: "kube-api-access-6k7xc") pod "8d66c115-54a1-44a4-9f86-c3821376fdd0" (UID: "8d66c115-54a1-44a4-9f86-c3821376fdd0"). InnerVolumeSpecName "kube-api-access-6k7xc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:06.207153 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.207068 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k7xc\" (UniqueName: \"kubernetes.io/projected/8d66c115-54a1-44a4-9f86-c3821376fdd0-kube-api-access-6k7xc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:45:06.919923 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.919895 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" Jul 06 19:45:06.920100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.919937 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-l4w4m" event={"ID":"8d66c115-54a1-44a4-9f86-c3821376fdd0","Type":"ContainerDied","Data":"d5f3a81346a1c4371a0b10da92f4ae49a00d2aab84d0704e522e4838e8fcc3ca"} Jul 06 19:45:06.920100 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:06.919989 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5f3a81346a1c4371a0b10da92f4ae49a00d2aab84d0704e522e4838e8fcc3ca" Jul 06 19:45:12.506747 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:12.506711 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:45:35.507429 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:35.507377 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:45:47.202354 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:45:47.202321 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:46:11.096350 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:46:11.096275 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:46:23.594214 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:46:23.594182 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:46:38.606181 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:46:38.606147 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:46:49.118107 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:46:49.118070 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:46:58.204355 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:46:58.204321 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:47:06.995674 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:47:06.995642 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:47:16.600531 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:47:16.600495 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:49:10.032429 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:49:10.032344 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:49:19.758874 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:49:19.758832 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:49:32.399848 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:49:32.399811 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:49:45.896117 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:49:45.896075 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:49:55.802005 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:49:55.801971 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:50:07.394885 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:50:07.394849 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:50:15.896773 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:50:15.896741 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:50:26.804723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:50:26.804689 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:50:48.521330 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:50:48.521243 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:50:59.009236 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:50:59.009201 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:51:21.837497 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:51:21.837456 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:51:30.842595 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:51:30.842566 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:51:40.635383 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:51:40.635353 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:51:52.410327 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:51:52.410285 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:52:08.809180 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:52:08.809102 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:52:18.795348 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:52:18.795314 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:52:27.610194 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:52:27.610163 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:52:37.596406 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:52:37.596365 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:52:46.605012 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:52:46.604972 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:53:13.914223 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:53:13.914187 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:53:34.810461 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:53:34.810373 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:53:43.921735 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:53:43.921698 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:53:53.492997 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:53:53.492962 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:54:06.814521 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:54:06.814473 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:54:15.612345 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:54:15.612311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:54:27.931916 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:54:27.931883 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:54:39.524468 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:54:39.524434 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:54:49.410374 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:54:49.410339 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:01.710401 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:01.710367 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:13.504493 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:13.504449 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:19.209564 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.209521 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm"] Jul 06 19:55:19.210743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.210716 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d66c115-54a1-44a4-9f86-c3821376fdd0" containerName="cleanup" Jul 06 19:55:19.210743 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.210744 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d66c115-54a1-44a4-9f86-c3821376fdd0" containerName="cleanup" Jul 06 19:55:19.210902 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.210847 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d66c115-54a1-44a4-9f86-c3821376fdd0" containerName="cleanup" Jul 06 19:55:19.214034 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.214015 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.216989 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.216969 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9ce93acb-openshift-default-dockercfg-qlx8n\"" Jul 06 19:55:19.221813 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.221788 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-data\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.221911 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.221827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-socket\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.221911 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.221867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-envoy\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.221911 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.221889 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-podinfo\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.222079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.221967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-token\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.222079 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.222040 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istiod-ca-cert\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.222189 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.222091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8h2\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-kube-api-access-hl8h2\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.222189 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.222126 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-certs\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.222189 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.222147 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-credential-socket\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.236485 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.236463 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm"] Jul 06 19:55:19.323439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.323380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-token\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.323731 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.323713 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istiod-ca-cert\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.323851 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.323834 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8h2\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-kube-api-access-hl8h2\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.323972 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.323959 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-certs\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.324091 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.324078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-credential-socket\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.324205 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.324191 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-data\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.324303 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.324291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-socket\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.324410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.324379 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-envoy\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.324513 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.324500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-podinfo\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.324676 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.324653 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-certs\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.325044 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.325016 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-credential-socket\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.325133 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.325018 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istiod-ca-cert\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.325294 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.325264 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-socket\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.325615 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.325589 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-data\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.327269 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.327247 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-podinfo\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.327379 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.327289 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-envoy\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.334359 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.334334 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-token\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.334964 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.334941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8h2\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-kube-api-access-hl8h2\") pod \"e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.524689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.524659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:19.666101 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.666071 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm"] Jul 06 19:55:19.669352 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:55:19.669326 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec83c5bc_00a8_4a6a_ad4e_1f0b218e3000.slice/crio-6647aacec11417f20e32cdb7a95023719bbaae6b7839418994f61ec71782b1e2 WatchSource:0}: Error finding container 6647aacec11417f20e32cdb7a95023719bbaae6b7839418994f61ec71782b1e2: Status 404 returned error can't find the container with id 6647aacec11417f20e32cdb7a95023719bbaae6b7839418994f61ec71782b1e2 Jul 06 19:55:19.671806 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.671771 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:19.671882 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.671838 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:19.671882 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:19.671865 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:20.639990 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:20.639951 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" event={"ID":"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000","Type":"ContainerStarted","Data":"80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06"} Jul 06 19:55:20.640408 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:20.640008 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" event={"ID":"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000","Type":"ContainerStarted","Data":"6647aacec11417f20e32cdb7a95023719bbaae6b7839418994f61ec71782b1e2"} Jul 06 19:55:20.664948 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:20.664899 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" podStartSLOduration=1.664884452 podStartE2EDuration="1.664884452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:20.663231889 +0000 UTC m=+1810.541370644" watchObservedRunningTime="2026-07-06 19:55:20.664884452 +0000 UTC m=+1810.543023180" Jul 06 19:55:21.525329 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:21.525293 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:21.529927 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:21.529904 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:21.644991 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:21.644961 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:21.646013 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:21.645995 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:24.298619 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:24.298585 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:25.678590 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:25.678556 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm"] Jul 06 19:55:25.679018 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:25.678726 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" podUID="ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" containerName="istio-proxy" containerID="cri-o://80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06" gracePeriod=30 Jul 06 19:55:31.926358 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:31.926303 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:32.034689 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.034621 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8"] Jul 06 19:55:32.034964 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.034952 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" containerName="istio-proxy" Jul 06 19:55:32.035055 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.034965 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" containerName="istio-proxy" Jul 06 19:55:32.035055 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.035021 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" containerName="istio-proxy" Jul 06 19:55:32.037336 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.037317 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.040274 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.040254 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6dbb1fec-openshift-default-dockercfg-r6zb9\"" Jul 06 19:55:32.042147 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042131 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl8h2\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-kube-api-access-hl8h2\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042212 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042160 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-envoy\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042254 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042223 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-socket\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042254 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042238 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-token\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042260 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-data\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042339 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042291 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-credential-socket\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042450 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042424 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-certs\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042510 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042489 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istiod-ca-cert\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042566 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042535 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-podinfo\") pod \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\" (UID: \"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000\") " Jul 06 19:55:32.042620 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042598 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:32.042783 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042670 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:32.042996 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042753 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:32.042996 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042931 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.042996 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042952 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.042996 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.042965 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.043580 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.043523 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:32.043580 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.043557 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:55:32.045457 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.045178 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:55:32.045609 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.045512 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:32.045609 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.045549 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-kube-api-access-hl8h2" (OuterVolumeSpecName: "kube-api-access-hl8h2") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "kube-api-access-hl8h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:55:32.045609 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.045548 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" (UID: "ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:55:32.057119 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.057095 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8"] Jul 06 19:55:32.143353 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-certs\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143502 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143450 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea75333-ba70-465e-bacd-5996a35b0660-istiod-ca-cert\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143567 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-istio-token\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143567 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4j78\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-kube-api-access-x4j78\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143567 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-socket\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-envoy\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea75333-ba70-465e-bacd-5996a35b0660-istio-podinfo\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-credential-socket\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143723 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-data\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.143878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143765 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.143878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143787 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.143878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143796 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl8h2\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-kube-api-access-hl8h2\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.143878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143811 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.143878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143823 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.143878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.143831 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:32.244369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244338 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-istio-token\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244370 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4j78\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-kube-api-access-x4j78\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-socket\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244451 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-envoy\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea75333-ba70-465e-bacd-5996a35b0660-istio-podinfo\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-credential-socket\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-data\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244614 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-certs\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244909 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea75333-ba70-465e-bacd-5996a35b0660-istiod-ca-cert\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244963 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244912 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-socket\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.244963 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.244951 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-credential-socket\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.245036 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.245006 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-data\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.245095 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.245077 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-certs\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.245315 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.245300 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea75333-ba70-465e-bacd-5996a35b0660-istiod-ca-cert\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.247307 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.247281 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-envoy\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.247529 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.247513 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea75333-ba70-465e-bacd-5996a35b0660-istio-podinfo\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.252529 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.252508 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-istio-token\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.252785 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.252767 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4j78\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-kube-api-access-x4j78\") pod \"e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.367082 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.367015 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:32.503073 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.503047 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8"] Jul 06 19:55:32.505100 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:55:32.505077 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea75333_ba70_465e_bacd_5996a35b0660.slice/crio-0883148257cab4ed41cc34fe9e4cb7af9dee9a1efe6773887f6f3b819401d66a WatchSource:0}: Error finding container 0883148257cab4ed41cc34fe9e4cb7af9dee9a1efe6773887f6f3b819401d66a: Status 404 returned error can't find the container with id 0883148257cab4ed41cc34fe9e4cb7af9dee9a1efe6773887f6f3b819401d66a Jul 06 19:55:32.507098 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.507063 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:32.507186 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.507129 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:32.507186 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.507169 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:32.695980 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.695888 2555 generic.go:356] "Generic (PLEG): container finished" podID="ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" containerID="80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06" exitCode=0 Jul 06 19:55:32.695980 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.695942 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" Jul 06 19:55:32.695980 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.695968 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" event={"ID":"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000","Type":"ContainerDied","Data":"80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06"} Jul 06 19:55:32.696221 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.696028 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm" event={"ID":"ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000","Type":"ContainerDied","Data":"6647aacec11417f20e32cdb7a95023719bbaae6b7839418994f61ec71782b1e2"} Jul 06 19:55:32.696221 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.696060 2555 scope.go:117] "RemoveContainer" containerID="80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06" Jul 06 19:55:32.697876 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.697854 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" event={"ID":"9ea75333-ba70-465e-bacd-5996a35b0660","Type":"ContainerStarted","Data":"f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f"} Jul 06 19:55:32.697988 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.697898 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" event={"ID":"9ea75333-ba70-465e-bacd-5996a35b0660","Type":"ContainerStarted","Data":"0883148257cab4ed41cc34fe9e4cb7af9dee9a1efe6773887f6f3b819401d66a"} Jul 06 19:55:32.707250 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.707231 2555 scope.go:117] "RemoveContainer" containerID="80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06" Jul 06 19:55:32.707528 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:55:32.707498 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06\": container with ID starting with 80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06 not found: ID does not exist" containerID="80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06" Jul 06 19:55:32.707628 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.707538 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06"} err="failed to get container status \"80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06\": rpc error: code = NotFound desc = could not find container \"80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06\": container with ID starting with 80859279a4fe4e058fc625c44ecc38356f99484b41381400dd9ab2f1be547b06 not found: ID does not exist" Jul 06 19:55:32.729211 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.729171 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" podStartSLOduration=0.729157773 podStartE2EDuration="729.157773ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:32.727754042 +0000 UTC m=+1822.605892771" watchObservedRunningTime="2026-07-06 19:55:32.729157773 +0000 UTC m=+1822.607296501" Jul 06 19:55:32.747708 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.747686 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm"] Jul 06 19:55:32.753203 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:32.753182 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9ce93acb-openshift-default-59c7569d77-jgsbm"] Jul 06 19:55:33.367847 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:33.367818 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:33.372362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:33.372342 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:33.703507 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:33.703426 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:33.704334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:33.704319 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:33.851901 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:33.851873 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000" path="/var/lib/kubelet/pods/ec83c5bc-00a8-4a6a-ad4e-1f0b218e3000/volumes" Jul 06 19:55:35.790725 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:35.790694 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:43.754232 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:43.754200 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ea75333-ba70-465e-bacd-5996a35b0660" containerID="f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f" exitCode=0 Jul 06 19:55:43.754649 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:43.754243 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" event={"ID":"9ea75333-ba70-465e-bacd-5996a35b0660","Type":"ContainerDied","Data":"f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f"} Jul 06 19:55:43.754649 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:43.754612 2555 scope.go:117] "RemoveContainer" containerID="f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f" Jul 06 19:55:43.755641 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:43.755610 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:43.755716 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:43.755697 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:43.755755 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:43.755744 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:44.479831 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:44.479798 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8"] Jul 06 19:55:44.759967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:44.759934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" event={"ID":"9ea75333-ba70-465e-bacd-5996a35b0660","Type":"ContainerStarted","Data":"1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a"} Jul 06 19:55:44.760369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:44.759984 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" containerID="cri-o://1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a" gracePeriod=30 Jul 06 19:55:46.729157 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:46.729123 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:48.703370 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:48.703333 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:50.001694 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.001673 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:50.117748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117672 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-socket\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.117748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117705 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-credential-socket\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.117748 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117732 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-data\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117764 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-envoy\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117804 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea75333-ba70-465e-bacd-5996a35b0660-istio-podinfo\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117847 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea75333-ba70-465e-bacd-5996a35b0660-istiod-ca-cert\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117878 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4j78\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-kube-api-access-x4j78\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117916 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-certs\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.117975 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-istio-token\") pod \"9ea75333-ba70-465e-bacd-5996a35b0660\" (UID: \"9ea75333-ba70-465e-bacd-5996a35b0660\") " Jul 06 19:55:50.118316 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118011 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:50.118316 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118191 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:50.118316 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118207 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:50.118316 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118299 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.118543 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118317 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.118543 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118332 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.118648 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118533 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea75333-ba70-465e-bacd-5996a35b0660-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:55:50.118773 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.118746 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:50.120001 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.119977 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:55:50.120266 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.120239 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-kube-api-access-x4j78" (OuterVolumeSpecName: "kube-api-access-x4j78") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "kube-api-access-x4j78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:55:50.120574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.120542 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ea75333-ba70-465e-bacd-5996a35b0660-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:55:50.120574 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.120566 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ea75333-ba70-465e-bacd-5996a35b0660" (UID: "9ea75333-ba70-465e-bacd-5996a35b0660"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:55:50.218801 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.218769 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.218801 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.218793 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea75333-ba70-465e-bacd-5996a35b0660-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.218801 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.218802 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea75333-ba70-465e-bacd-5996a35b0660-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.218801 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.218810 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea75333-ba70-465e-bacd-5996a35b0660-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.219040 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.218819 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4j78\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-kube-api-access-x4j78\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.219040 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.218827 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea75333-ba70-465e-bacd-5996a35b0660-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:55:50.787728 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.787693 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ea75333-ba70-465e-bacd-5996a35b0660" containerID="1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a" exitCode=0 Jul 06 19:55:50.787884 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.787743 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" Jul 06 19:55:50.787884 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.787768 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" event={"ID":"9ea75333-ba70-465e-bacd-5996a35b0660","Type":"ContainerDied","Data":"1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a"} Jul 06 19:55:50.787884 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.787818 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8" event={"ID":"9ea75333-ba70-465e-bacd-5996a35b0660","Type":"ContainerDied","Data":"0883148257cab4ed41cc34fe9e4cb7af9dee9a1efe6773887f6f3b819401d66a"} Jul 06 19:55:50.787884 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.787841 2555 scope.go:117] "RemoveContainer" containerID="1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a" Jul 06 19:55:50.796994 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.796978 2555 scope.go:117] "RemoveContainer" containerID="f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f" Jul 06 19:55:50.804355 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.804340 2555 scope.go:117] "RemoveContainer" containerID="1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a" Jul 06 19:55:50.804605 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:55:50.804589 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a\": container with ID starting with 1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a not found: ID does not exist" containerID="1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a" Jul 06 19:55:50.804656 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.804613 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a"} err="failed to get container status \"1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a\": rpc error: code = NotFound desc = could not find container \"1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a\": container with ID starting with 1e50e69360501a47c736bccfdedba1a6a90fd3eed39d80eea399acdfca3cf87a not found: ID does not exist" Jul 06 19:55:50.804656 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.804629 2555 scope.go:117] "RemoveContainer" containerID="f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f" Jul 06 19:55:50.804830 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:55:50.804814 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f\": container with ID starting with f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f not found: ID does not exist" containerID="f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f" Jul 06 19:55:50.804869 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.804834 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f"} err="failed to get container status \"f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f\": rpc error: code = NotFound desc = could not find container \"f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f\": container with ID starting with f31ed0e4027b0c275200fb52341da7ab4d66936bf0884e4a99041a8abc978d9f not found: ID does not exist" Jul 06 19:55:50.813907 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.813888 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8"] Jul 06 19:55:50.821795 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:50.821773 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6dbb1fec-openshift-default-7b5857bddf-nmrh8"] Jul 06 19:55:51.257074 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.257047 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc"] Jul 06 19:55:51.257622 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.257606 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" Jul 06 19:55:51.257673 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.257628 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" Jul 06 19:55:51.257673 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.257642 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" Jul 06 19:55:51.257673 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.257650 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" Jul 06 19:55:51.257761 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.257721 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" Jul 06 19:55:51.262701 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.262680 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.265492 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.265303 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-584eb001-openshift-default-dockercfg-p87d2\"" Jul 06 19:55:51.281831 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.281809 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc"] Jul 06 19:55:51.430244 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-podinfo\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-credential-socket\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-certs\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-envoy\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430439 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-data\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430579 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4pks\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-kube-api-access-j4pks\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430579 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-token\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430579 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430509 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istiod-ca-cert\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.430579 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.430536 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-socket\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531096 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531022 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-credential-socket\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531096 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531056 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-certs\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531096 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531081 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-envoy\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-data\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4pks\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-kube-api-access-j4pks\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-token\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istiod-ca-cert\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-socket\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531340 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-podinfo\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531667 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531485 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-credential-socket\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531667 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-data\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531667 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531646 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-certs\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.531786 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531698 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-socket\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.532003 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.531978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istiod-ca-cert\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.533398 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.533366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-envoy\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.533698 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.533681 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-podinfo\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.540235 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.540217 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-token\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.540570 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.540545 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4pks\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-kube-api-access-j4pks\") pod \"e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.574462 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.574441 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:51.709914 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.709892 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc"] Jul 06 19:55:51.711931 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:55:51.711899 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8fefa9_0514_4aba_bc0b_f90c16eed754.slice/crio-fcec237ca792b9b0c22431bc1fb3c0015471b50283ed841140910ad00f6b7932 WatchSource:0}: Error finding container fcec237ca792b9b0c22431bc1fb3c0015471b50283ed841140910ad00f6b7932: Status 404 returned error can't find the container with id fcec237ca792b9b0c22431bc1fb3c0015471b50283ed841140910ad00f6b7932 Jul 06 19:55:51.713974 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.713945 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:51.714054 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.714001 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:51.714054 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.714030 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:55:51.795058 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.794965 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" event={"ID":"dc8fefa9-0514-4aba-bc0b-f90c16eed754","Type":"ContainerStarted","Data":"0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca"} Jul 06 19:55:51.795058 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.795025 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" event={"ID":"dc8fefa9-0514-4aba-bc0b-f90c16eed754","Type":"ContainerStarted","Data":"fcec237ca792b9b0c22431bc1fb3c0015471b50283ed841140910ad00f6b7932"} Jul 06 19:55:51.821609 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.821558 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" podStartSLOduration=0.821537142 podStartE2EDuration="821.537142ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:51.820744499 +0000 UTC m=+1841.698883232" watchObservedRunningTime="2026-07-06 19:55:51.821537142 +0000 UTC m=+1841.699675871" Jul 06 19:55:51.851721 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:51.851609 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" path="/var/lib/kubelet/pods/9ea75333-ba70-465e-bacd-5996a35b0660/volumes" Jul 06 19:55:52.575378 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:52.575350 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:52.580821 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:52.580799 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:52.800893 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:52.800869 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:52.801807 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:52.801791 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:55:56.814032 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:56.813997 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:55:57.127456 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:57.127340 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc"] Jul 06 19:55:57.127621 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:55:57.127558 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" podUID="dc8fefa9-0514-4aba-bc0b-f90c16eed754" containerName="istio-proxy" containerID="cri-o://0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca" gracePeriod=30 Jul 06 19:56:02.389112 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.389055 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:56:02.431885 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.431858 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4pks\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-kube-api-access-j4pks\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432024 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.431897 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-socket\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432024 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.431927 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-envoy\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432024 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.431963 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-podinfo\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432174 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432074 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-token\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432174 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432130 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-certs\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432280 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432176 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-credential-socket\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432280 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432184 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:02.432280 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432223 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istiod-ca-cert\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432474 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432324 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-data\") pod \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\" (UID: \"dc8fefa9-0514-4aba-bc0b-f90c16eed754\") " Jul 06 19:56:02.432714 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432651 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.432714 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432650 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:02.432714 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432658 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:02.432947 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432720 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:02.432947 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.432793 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:02.434284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.434247 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:02.434414 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.434374 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-kube-api-access-j4pks" (OuterVolumeSpecName: "kube-api-access-j4pks") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "kube-api-access-j4pks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:02.434553 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.434534 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:02.434601 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.434539 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc8fefa9-0514-4aba-bc0b-f90c16eed754" (UID: "dc8fefa9-0514-4aba-bc0b-f90c16eed754"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:56:02.533310 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533280 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533310 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533306 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533310 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533315 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533560 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533326 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533560 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533336 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533560 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533345 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533560 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533354 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc8fefa9-0514-4aba-bc0b-f90c16eed754-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.533560 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.533362 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4pks\" (UniqueName: \"kubernetes.io/projected/dc8fefa9-0514-4aba-bc0b-f90c16eed754-kube-api-access-j4pks\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:56:02.849430 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.849369 2555 generic.go:356] "Generic (PLEG): container finished" podID="dc8fefa9-0514-4aba-bc0b-f90c16eed754" containerID="0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca" exitCode=0 Jul 06 19:56:02.849430 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.849432 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" Jul 06 19:56:02.849644 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.849443 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" event={"ID":"dc8fefa9-0514-4aba-bc0b-f90c16eed754","Type":"ContainerDied","Data":"0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca"} Jul 06 19:56:02.849644 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.849491 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc" event={"ID":"dc8fefa9-0514-4aba-bc0b-f90c16eed754","Type":"ContainerDied","Data":"fcec237ca792b9b0c22431bc1fb3c0015471b50283ed841140910ad00f6b7932"} Jul 06 19:56:02.849644 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.849519 2555 scope.go:117] "RemoveContainer" containerID="0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca" Jul 06 19:56:02.858410 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.858369 2555 scope.go:117] "RemoveContainer" containerID="0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca" Jul 06 19:56:02.858662 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:56:02.858641 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca\": container with ID starting with 0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca not found: ID does not exist" containerID="0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca" Jul 06 19:56:02.858717 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.858671 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca"} err="failed to get container status \"0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca\": rpc error: code = NotFound desc = could not find container \"0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca\": container with ID starting with 0d17df3958149e196414ea69010605aef601f170c34b150627b45d4019e349ca not found: ID does not exist" Jul 06 19:56:02.872119 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.872095 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc"] Jul 06 19:56:02.879967 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:02.879932 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-584eb001-openshift-default-5c87fdfb47-c7pqc"] Jul 06 19:56:03.851077 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:03.851047 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc8fefa9-0514-4aba-bc0b-f90c16eed754" path="/var/lib/kubelet/pods/dc8fefa9-0514-4aba-bc0b-f90c16eed754/volumes" Jul 06 19:56:07.499470 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:56:07.499436 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:57:26.300476 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:26.300443 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:57:33.901336 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:33.901298 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:57:40.867797 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.867759 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms"] Jul 06 19:57:40.868280 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.868261 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc8fefa9-0514-4aba-bc0b-f90c16eed754" containerName="istio-proxy" Jul 06 19:57:40.868328 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.868283 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc8fefa9-0514-4aba-bc0b-f90c16eed754" containerName="istio-proxy" Jul 06 19:57:40.868362 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.868352 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc8fefa9-0514-4aba-bc0b-f90c16eed754" containerName="istio-proxy" Jul 06 19:57:40.868412 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.868361 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea75333-ba70-465e-bacd-5996a35b0660" containerName="istio-proxy" Jul 06 19:57:40.871826 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.871808 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.874301 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.874278 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a04b5bb9-openshift-default-dockercfg-2l82g\"" Jul 06 19:57:40.893852 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.893823 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms"] Jul 06 19:57:40.994405 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-data\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994405 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994399 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585fcbc0-9249-414b-8e94-5ed28b76c87b-istiod-ca-cert\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994615 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-certs\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994615 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994480 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-podinfo\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994615 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s59s\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-kube-api-access-4s59s\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994615 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994569 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-token\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994754 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994618 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-envoy\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994754 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-credential-socket\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:40.994754 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:40.994690 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-socket\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095548 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-envoy\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095713 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095560 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-credential-socket\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095713 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-socket\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095794 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095734 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-data\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095794 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585fcbc0-9249-414b-8e94-5ed28b76c87b-istiod-ca-cert\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095895 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-certs\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095895 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-podinfo\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.095895 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095859 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s59s\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-kube-api-access-4s59s\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.096048 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-credential-socket\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.096048 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.095933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-token\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.096156 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.096094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-data\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.096156 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.096124 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-socket\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.096334 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.096311 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-certs\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.096472 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.096454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585fcbc0-9249-414b-8e94-5ed28b76c87b-istiod-ca-cert\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.097877 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.097855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-envoy\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.098250 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.098229 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-podinfo\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.104381 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.104353 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-token\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.104629 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.104610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s59s\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-kube-api-access-4s59s\") pod \"e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.181865 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.181790 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:41.319467 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.319436 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms"] Jul 06 19:57:41.319592 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:57:41.319567 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585fcbc0_9249_414b_8e94_5ed28b76c87b.slice/crio-8da79cff6507eccfe96bfa24d6437e1afc2f7564a8e8dcba8aa8340fcd24e2f4 WatchSource:0}: Error finding container 8da79cff6507eccfe96bfa24d6437e1afc2f7564a8e8dcba8aa8340fcd24e2f4: Status 404 returned error can't find the container with id 8da79cff6507eccfe96bfa24d6437e1afc2f7564a8e8dcba8aa8340fcd24e2f4 Jul 06 19:57:41.321816 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.321783 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:57:41.321877 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.321860 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:57:41.321913 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:41.321902 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:57:42.297833 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:42.297793 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" event={"ID":"585fcbc0-9249-414b-8e94-5ed28b76c87b","Type":"ContainerStarted","Data":"e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f"} Jul 06 19:57:42.298222 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:42.297886 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" event={"ID":"585fcbc0-9249-414b-8e94-5ed28b76c87b","Type":"ContainerStarted","Data":"8da79cff6507eccfe96bfa24d6437e1afc2f7564a8e8dcba8aa8340fcd24e2f4"} Jul 06 19:57:42.807598 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:42.807544 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" podStartSLOduration=2.807528441 podStartE2EDuration="2.807528441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:42.320169345 +0000 UTC m=+1952.198308074" watchObservedRunningTime="2026-07-06 19:57:42.807528441 +0000 UTC m=+1952.685667169" Jul 06 19:57:42.808108 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:42.808091 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:57:43.182265 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:43.182184 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:43.186972 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:43.186950 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:43.302444 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:43.302414 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:43.303277 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:43.303261 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:52.897022 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:52.896985 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:57:56.375668 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:56.375634 2555 generic.go:356] "Generic (PLEG): container finished" podID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerID="e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f" exitCode=0 Jul 06 19:57:56.376112 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:56.375708 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" event={"ID":"585fcbc0-9249-414b-8e94-5ed28b76c87b","Type":"ContainerDied","Data":"e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f"} Jul 06 19:57:56.376112 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:56.376074 2555 scope.go:117] "RemoveContainer" containerID="e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f" Jul 06 19:57:56.377000 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:56.376975 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:57:56.377052 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:56.377039 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:57:56.377096 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:56.377070 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:57:57.382644 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:57.382607 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" event={"ID":"585fcbc0-9249-414b-8e94-5ed28b76c87b","Type":"ContainerStarted","Data":"7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49"} Jul 06 19:57:58.182498 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:58.182465 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:58.183702 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:58.183677 2555 patch_prober.go:28] interesting pod/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 06 19:57:58.183815 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:58.183727 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 06 19:57:58.302899 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:58.302871 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:57:59.182918 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:59.182885 2555 patch_prober.go:28] interesting pod/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 06 19:57:59.183281 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:57:59.182938 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 06 19:58:00.182770 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:00.182737 2555 patch_prober.go:28] interesting pod/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 06 19:58:00.182938 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:00.182789 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 06 19:58:01.182406 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:01.182365 2555 patch_prober.go:28] interesting pod/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 06 19:58:01.182588 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:01.182441 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 06 19:58:02.186789 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:02.186709 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:58:02.187823 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:02.187804 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:58:17.813504 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:17.813467 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:58:21.439752 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:21.439720 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms"] Jul 06 19:58:21.440129 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:21.439957 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" containerID="cri-o://7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49" gracePeriod=30 Jul 06 19:58:26.682973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.682951 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:58:26.809652 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809625 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-token\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.809806 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809679 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-data\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.809806 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809718 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-podinfo\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.809806 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809755 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-credential-socket\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.809806 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809781 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-socket\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.810021 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809821 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-certs\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.810021 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809849 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585fcbc0-9249-414b-8e94-5ed28b76c87b-istiod-ca-cert\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.810021 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809874 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-envoy\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.810021 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.809920 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s59s\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-kube-api-access-4s59s\") pod \"585fcbc0-9249-414b-8e94-5ed28b76c87b\" (UID: \"585fcbc0-9249-414b-8e94-5ed28b76c87b\") " Jul 06 19:58:26.810222 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.810065 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:58:26.810284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.810246 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.810284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.810245 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585fcbc0-9249-414b-8e94-5ed28b76c87b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:58:26.810426 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.810313 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:58:26.810490 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.810448 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:58:26.810952 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.810926 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-data" (OuterVolumeSpecName: "istio-data") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:58:26.811878 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.811854 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-token" (OuterVolumeSpecName: "istio-token") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:58:26.811991 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.811973 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 19:58:26.812222 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.812202 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:58:26.812326 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.812224 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-kube-api-access-4s59s" (OuterVolumeSpecName: "kube-api-access-4s59s") pod "585fcbc0-9249-414b-8e94-5ed28b76c87b" (UID: "585fcbc0-9249-414b-8e94-5ed28b76c87b"). InnerVolumeSpecName "kube-api-access-4s59s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:58:26.910692 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910660 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s59s\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-kube-api-access-4s59s\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910692 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910689 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910702 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910714 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910728 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910834 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910858 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/585fcbc0-9249-414b-8e94-5ed28b76c87b-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:26.910880 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:26.910873 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/585fcbc0-9249-414b-8e94-5ed28b76c87b-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 19:58:27.527897 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.527862 2555 generic.go:356] "Generic (PLEG): container finished" podID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerID="7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49" exitCode=0 Jul 06 19:58:27.528083 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.527905 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" Jul 06 19:58:27.528083 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.527943 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" event={"ID":"585fcbc0-9249-414b-8e94-5ed28b76c87b","Type":"ContainerDied","Data":"7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49"} Jul 06 19:58:27.528083 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.527995 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms" event={"ID":"585fcbc0-9249-414b-8e94-5ed28b76c87b","Type":"ContainerDied","Data":"8da79cff6507eccfe96bfa24d6437e1afc2f7564a8e8dcba8aa8340fcd24e2f4"} Jul 06 19:58:27.528083 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.528017 2555 scope.go:117] "RemoveContainer" containerID="7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49" Jul 06 19:58:27.536720 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.536707 2555 scope.go:117] "RemoveContainer" containerID="e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f" Jul 06 19:58:27.543837 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.543822 2555 scope.go:117] "RemoveContainer" containerID="7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49" Jul 06 19:58:27.544075 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:58:27.544058 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49\": container with ID starting with 7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49 not found: ID does not exist" containerID="7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49" Jul 06 19:58:27.544131 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.544084 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49"} err="failed to get container status \"7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49\": rpc error: code = NotFound desc = could not find container \"7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49\": container with ID starting with 7f2031cb9339bfa176deea5ddbbb26fd3bccd2e5a351b8eb6036e8fb09b7bb49 not found: ID does not exist" Jul 06 19:58:27.544131 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.544100 2555 scope.go:117] "RemoveContainer" containerID="e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f" Jul 06 19:58:27.544342 ip-10-0-128-19 kubenswrapper[2555]: E0706 19:58:27.544323 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f\": container with ID starting with e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f not found: ID does not exist" containerID="e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f" Jul 06 19:58:27.544427 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.544352 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f"} err="failed to get container status \"e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f\": rpc error: code = NotFound desc = could not find container \"e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f\": container with ID starting with e4b8be03aa5940f7f8a8506a2b64901f925290c1e9c7fe2c9b3a1682eb2d078f not found: ID does not exist" Jul 06 19:58:27.555276 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.555254 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms"] Jul 06 19:58:27.558643 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.558624 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a04b5bb9-openshift-default-84c78c5b87-mckms"] Jul 06 19:58:27.850973 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:27.850894 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" path="/var/lib/kubelet/pods/585fcbc0-9249-414b-8e94-5ed28b76c87b/volumes" Jul 06 19:58:41.679993 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.679962 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q"] Jul 06 19:58:41.680353 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.680308 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" Jul 06 19:58:41.680353 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.680320 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" Jul 06 19:58:41.680461 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.680404 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" Jul 06 19:58:41.680461 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.680412 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" Jul 06 19:58:41.683413 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.683377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.686509 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.686486 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2b7eaa8b-openshift-default-dockercfg-2vgjq\"" Jul 06 19:58:41.716995 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.716975 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q"] Jul 06 19:58:41.838492 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838461 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-data\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838492 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx9nc\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-kube-api-access-tx9nc\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-envoy\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb37066-74ed-4015-803d-cc3db621588e-istiod-ca-cert\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-istio-token\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-socket\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838683 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-certs\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838843 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb37066-74ed-4015-803d-cc3db621588e-istio-podinfo\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.838843 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.838734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-credential-socket\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940016 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.939932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-envoy\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940016 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.939972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb37066-74ed-4015-803d-cc3db621588e-istiod-ca-cert\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940016 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.939996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-istio-token\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940021 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-socket\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-certs\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb37066-74ed-4015-803d-cc3db621588e-istio-podinfo\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940110 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-credential-socket\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-data\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940284 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940188 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx9nc\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-kube-api-access-tx9nc\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940651 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-socket\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940707 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940682 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-data\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940745 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-certs\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940789 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940755 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-credential-socket\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.940829 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.940796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb37066-74ed-4015-803d-cc3db621588e-istiod-ca-cert\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.942401 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.942364 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-envoy\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.942629 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.942606 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb37066-74ed-4015-803d-cc3db621588e-istio-podinfo\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.953763 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.953741 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-istio-token\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.954179 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.954157 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx9nc\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-kube-api-access-tx9nc\") pod \"e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:41.993180 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:41.993152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:42.134527 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.134429 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q"] Jul 06 19:58:42.136782 ip-10-0-128-19 kubenswrapper[2555]: W0706 19:58:42.136759 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb37066_74ed_4015_803d_cc3db621588e.slice/crio-b173c79648c3559482a026d00ba87f59d7e8fd8c4af0f028a8a7e0bd5416cb29 WatchSource:0}: Error finding container b173c79648c3559482a026d00ba87f59d7e8fd8c4af0f028a8a7e0bd5416cb29: Status 404 returned error can't find the container with id b173c79648c3559482a026d00ba87f59d7e8fd8c4af0f028a8a7e0bd5416cb29 Jul 06 19:58:42.141376 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.141346 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:58:42.141493 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.141432 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:58:42.141493 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.141470 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:58:42.601989 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.601953 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" event={"ID":"bdb37066-74ed-4015-803d-cc3db621588e","Type":"ContainerStarted","Data":"e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6"} Jul 06 19:58:42.602166 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.602004 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" event={"ID":"bdb37066-74ed-4015-803d-cc3db621588e","Type":"ContainerStarted","Data":"b173c79648c3559482a026d00ba87f59d7e8fd8c4af0f028a8a7e0bd5416cb29"} Jul 06 19:58:42.994142 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:42.994118 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:43.998267 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:43.998238 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:44.038921 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:44.038868 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" podStartSLOduration=3.038852168 podStartE2EDuration="3.038852168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:42.647296506 +0000 UTC m=+2012.525435238" watchObservedRunningTime="2026-07-06 19:58:44.038852168 +0000 UTC m=+2013.916990897" Jul 06 19:58:44.612036 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:44.611976 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:44.613127 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:44.613100 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:47.920042 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:47.920004 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:58:56.676369 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:56.676336 2555 generic.go:356] "Generic (PLEG): container finished" podID="bdb37066-74ed-4015-803d-cc3db621588e" containerID="e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6" exitCode=0 Jul 06 19:58:56.676812 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:56.676409 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" event={"ID":"bdb37066-74ed-4015-803d-cc3db621588e","Type":"ContainerDied","Data":"e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6"} Jul 06 19:58:56.676812 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:56.676772 2555 scope.go:117] "RemoveContainer" containerID="e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6" Jul 06 19:58:56.677800 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:56.677772 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:58:56.677860 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:56.677837 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:58:56.677898 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:56.677866 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 19:58:57.682809 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:57.682779 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" event={"ID":"bdb37066-74ed-4015-803d-cc3db621588e","Type":"ContainerStarted","Data":"28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31"} Jul 06 19:58:57.994245 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:57.994217 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:57.995365 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:57.995342 2555 patch_prober.go:28] interesting pod/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:58:57.995478 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:57.995404 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 06 19:58:58.994475 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:58.994440 2555 patch_prober.go:28] interesting pod/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:58:58.994914 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:58.994493 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 06 19:58:59.612797 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:59.612761 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:58:59.994124 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:59.994091 2555 patch_prober.go:28] interesting pod/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:58:59.994319 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:58:59.994147 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 06 19:59:00.994477 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:00.994440 2555 patch_prober.go:28] interesting pod/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 06 19:59:00.994877 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:00.994505 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 06 19:59:01.916199 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:01.916163 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:59:01.998163 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:01.998138 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:59:01.999076 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:01.999059 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 19:59:14.293023 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:14.292990 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 19:59:27.099819 ip-10-0-128-19 kubenswrapper[2555]: I0706 19:59:27.099788 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:00:00.148467 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.148428 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-g7tvl"] Jul 06 20:00:00.148997 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.148951 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" Jul 06 20:00:00.148997 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.148970 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="585fcbc0-9249-414b-8e94-5ed28b76c87b" containerName="istio-proxy" Jul 06 20:00:00.151907 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.151884 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:00.154861 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.154841 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bt2cj\"" Jul 06 20:00:00.161712 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.161685 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-g7tvl"] Jul 06 20:00:00.231507 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.231467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fppzt\" (UniqueName: \"kubernetes.io/projected/2ba9ff62-72cf-442c-8445-197a5ae73314-kube-api-access-fppzt\") pod \"maas-api-key-cleanup-29722800-g7tvl\" (UID: \"2ba9ff62-72cf-442c-8445-197a5ae73314\") " pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:00.332595 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.332554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fppzt\" (UniqueName: \"kubernetes.io/projected/2ba9ff62-72cf-442c-8445-197a5ae73314-kube-api-access-fppzt\") pod \"maas-api-key-cleanup-29722800-g7tvl\" (UID: \"2ba9ff62-72cf-442c-8445-197a5ae73314\") " pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:00.342342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.342304 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fppzt\" (UniqueName: \"kubernetes.io/projected/2ba9ff62-72cf-442c-8445-197a5ae73314-kube-api-access-fppzt\") pod \"maas-api-key-cleanup-29722800-g7tvl\" (UID: \"2ba9ff62-72cf-442c-8445-197a5ae73314\") " pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:00.462916 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.462836 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:00.595514 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.595489 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-g7tvl"] Jul 06 20:00:00.597679 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:00:00.597655 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba9ff62_72cf_442c_8445_197a5ae73314.slice/crio-acb2fde4e59cdb46367651fec781f6d61ea05196d759bba53267a7fa75851168 WatchSource:0}: Error finding container acb2fde4e59cdb46367651fec781f6d61ea05196d759bba53267a7fa75851168: Status 404 returned error can't find the container with id acb2fde4e59cdb46367651fec781f6d61ea05196d759bba53267a7fa75851168 Jul 06 20:00:00.970341 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.970311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" event={"ID":"2ba9ff62-72cf-442c-8445-197a5ae73314","Type":"ContainerStarted","Data":"4365f9934cc5f523747f07a5ea60a0498840649ec958fa45d464ca0f7d01a74f"} Jul 06 20:00:00.970522 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.970379 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" event={"ID":"2ba9ff62-72cf-442c-8445-197a5ae73314","Type":"ContainerStarted","Data":"acb2fde4e59cdb46367651fec781f6d61ea05196d759bba53267a7fa75851168"} Jul 06 20:00:00.991758 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:00.991708 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" podStartSLOduration=0.991691857 podStartE2EDuration="991.691857ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:00.989317325 +0000 UTC m=+2090.867456053" watchObservedRunningTime="2026-07-06 20:00:00.991691857 +0000 UTC m=+2090.869830585" Jul 06 20:00:01.976583 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:01.976493 2555 generic.go:356] "Generic (PLEG): container finished" podID="2ba9ff62-72cf-442c-8445-197a5ae73314" containerID="4365f9934cc5f523747f07a5ea60a0498840649ec958fa45d464ca0f7d01a74f" exitCode=0 Jul 06 20:00:01.976955 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:01.976587 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" event={"ID":"2ba9ff62-72cf-442c-8445-197a5ae73314","Type":"ContainerDied","Data":"4365f9934cc5f523747f07a5ea60a0498840649ec958fa45d464ca0f7d01a74f"} Jul 06 20:00:03.115003 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.114979 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:03.258019 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.257991 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fppzt\" (UniqueName: \"kubernetes.io/projected/2ba9ff62-72cf-442c-8445-197a5ae73314-kube-api-access-fppzt\") pod \"2ba9ff62-72cf-442c-8445-197a5ae73314\" (UID: \"2ba9ff62-72cf-442c-8445-197a5ae73314\") " Jul 06 20:00:03.260087 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.260063 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba9ff62-72cf-442c-8445-197a5ae73314-kube-api-access-fppzt" (OuterVolumeSpecName: "kube-api-access-fppzt") pod "2ba9ff62-72cf-442c-8445-197a5ae73314" (UID: "2ba9ff62-72cf-442c-8445-197a5ae73314"). InnerVolumeSpecName "kube-api-access-fppzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:03.359488 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.359456 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fppzt\" (UniqueName: \"kubernetes.io/projected/2ba9ff62-72cf-442c-8445-197a5ae73314-kube-api-access-fppzt\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:03.993902 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.993874 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" Jul 06 20:00:03.994067 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.993874 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-g7tvl" event={"ID":"2ba9ff62-72cf-442c-8445-197a5ae73314","Type":"ContainerDied","Data":"acb2fde4e59cdb46367651fec781f6d61ea05196d759bba53267a7fa75851168"} Jul 06 20:00:03.994067 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:03.993997 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acb2fde4e59cdb46367651fec781f6d61ea05196d759bba53267a7fa75851168" Jul 06 20:00:08.006171 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:08.006139 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:00:34.524472 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:34.524438 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q"] Jul 06 20:00:34.525071 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:34.524658 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" containerID="cri-o://28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31" gracePeriod=30 Jul 06 20:00:38.905205 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:38.905170 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:00:39.793511 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.793452 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 20:00:39.884436 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884384 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-socket\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884478 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb37066-74ed-4015-803d-cc3db621588e-istiod-ca-cert\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884502 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-istio-token\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884518 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-certs\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884534 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-credential-socket\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884562 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-envoy\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884580 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884589 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb37066-74ed-4015-803d-cc3db621588e-istio-podinfo\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.884684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884664 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-data\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884690 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx9nc\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-kube-api-access-tx9nc\") pod \"bdb37066-74ed-4015-803d-cc3db621588e\" (UID: \"bdb37066-74ed-4015-803d-cc3db621588e\") " Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884839 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884860 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.884930 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdb37066-74ed-4015-803d-cc3db621588e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.885080 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.885098 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb37066-74ed-4015-803d-cc3db621588e-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.885114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.885112 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.885497 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.885131 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.885721 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.885695 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:39.886724 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.886699 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:39.886861 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.886846 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-kube-api-access-tx9nc" (OuterVolumeSpecName: "kube-api-access-tx9nc") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "kube-api-access-tx9nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:39.886915 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.886887 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdb37066-74ed-4015-803d-cc3db621588e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:00:39.886979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.886962 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdb37066-74ed-4015-803d-cc3db621588e" (UID: "bdb37066-74ed-4015-803d-cc3db621588e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:00:39.986311 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.986280 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.986311 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.986306 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb37066-74ed-4015-803d-cc3db621588e-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.986311 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.986315 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb37066-74ed-4015-803d-cc3db621588e-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.986758 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.986323 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx9nc\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-kube-api-access-tx9nc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:39.986758 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:39.986333 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb37066-74ed-4015-803d-cc3db621588e-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:00:40.160741 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.160662 2555 generic.go:356] "Generic (PLEG): container finished" podID="bdb37066-74ed-4015-803d-cc3db621588e" containerID="28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31" exitCode=0 Jul 06 20:00:40.160741 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.160711 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" Jul 06 20:00:40.160741 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.160723 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" event={"ID":"bdb37066-74ed-4015-803d-cc3db621588e","Type":"ContainerDied","Data":"28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31"} Jul 06 20:00:40.160978 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.160767 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q" event={"ID":"bdb37066-74ed-4015-803d-cc3db621588e","Type":"ContainerDied","Data":"b173c79648c3559482a026d00ba87f59d7e8fd8c4af0f028a8a7e0bd5416cb29"} Jul 06 20:00:40.160978 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.160788 2555 scope.go:117] "RemoveContainer" containerID="28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31" Jul 06 20:00:40.169673 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.169657 2555 scope.go:117] "RemoveContainer" containerID="e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6" Jul 06 20:00:40.177070 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.177055 2555 scope.go:117] "RemoveContainer" containerID="28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31" Jul 06 20:00:40.177312 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:00:40.177292 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31\": container with ID starting with 28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31 not found: ID does not exist" containerID="28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31" Jul 06 20:00:40.177360 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.177320 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31"} err="failed to get container status \"28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31\": rpc error: code = NotFound desc = could not find container \"28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31\": container with ID starting with 28147d96d1b209b472e27c54ff5133a8b3f47ee622f13adb0e4d7832d8617c31 not found: ID does not exist" Jul 06 20:00:40.177360 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.177337 2555 scope.go:117] "RemoveContainer" containerID="e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6" Jul 06 20:00:40.177566 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:00:40.177548 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6\": container with ID starting with e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6 not found: ID does not exist" containerID="e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6" Jul 06 20:00:40.177635 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.177568 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6"} err="failed to get container status \"e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6\": rpc error: code = NotFound desc = could not find container \"e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6\": container with ID starting with e3d7a1cf82931179ee10977fde411c3292d4143b79b5c9e74c91c45a3eee86c6 not found: ID does not exist" Jul 06 20:00:40.183317 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.183296 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q"] Jul 06 20:00:40.189364 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:40.189346 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2b7eaa8b-openshift-default-6d9ddbd44c-zgp2q"] Jul 06 20:00:41.853475 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:41.853443 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdb37066-74ed-4015-803d-cc3db621588e" path="/var/lib/kubelet/pods/bdb37066-74ed-4015-803d-cc3db621588e/volumes" Jul 06 20:00:53.307237 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:00:53.307200 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:01:14.319461 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:14.319426 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ce8cad2-c6dd-40e1-b175-b641419c1665" containerID="b63b230c20a1a02b5193b8e3df8b93b6b5fcbdc30db2e4fa7e548a3f651cceef" exitCode=1 Jul 06 20:01:14.319860 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:14.319494 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" event={"ID":"9ce8cad2-c6dd-40e1-b175-b641419c1665","Type":"ContainerDied","Data":"b63b230c20a1a02b5193b8e3df8b93b6b5fcbdc30db2e4fa7e548a3f651cceef"} Jul 06 20:01:14.319860 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:14.319788 2555 scope.go:117] "RemoveContainer" containerID="b63b230c20a1a02b5193b8e3df8b93b6b5fcbdc30db2e4fa7e548a3f651cceef" Jul 06 20:01:14.432005 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:14.431973 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 20:01:15.325072 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:15.325036 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" event={"ID":"9ce8cad2-c6dd-40e1-b175-b641419c1665","Type":"ContainerStarted","Data":"818eafad2f8d9e7a04b16536c40a3d529664952eb04c893e293aa097622ddc6c"} Jul 06 20:01:15.325458 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:15.325093 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 20:01:16.216929 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:01:16.216883 2555 controller.go:195] "Failed to update lease" err="Put \"https://a1001293894be405898c003abcd1c266-fdf8e22a806cc7ce.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-19.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 20:01:16.457939 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:01:16.457910 2555 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-128-19.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again" Jul 06 20:01:26.332460 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:01:26.332428 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67bb7fcf7f-knrgc" Jul 06 20:02:05.707562 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707531 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28"] Jul 06 20:02:05.707968 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707878 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" Jul 06 20:02:05.707968 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707889 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" Jul 06 20:02:05.707968 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707910 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba9ff62-72cf-442c-8445-197a5ae73314" containerName="cleanup" Jul 06 20:02:05.707968 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707915 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba9ff62-72cf-442c-8445-197a5ae73314" containerName="cleanup" Jul 06 20:02:05.708099 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707976 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" Jul 06 20:02:05.708099 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707983 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba9ff62-72cf-442c-8445-197a5ae73314" containerName="cleanup" Jul 06 20:02:05.708099 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.707992 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" Jul 06 20:02:05.710846 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.710830 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.713418 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.713384 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-749ce0-openshift-default-dockercfg-9mdtd\"" Jul 06 20:02:05.726250 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.726230 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28"] Jul 06 20:02:05.744064 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-socket\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744162 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744078 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-certs\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744162 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-data\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744162 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-podinfo\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-envoy\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-token\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istiod-ca-cert\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9ltg\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-kube-api-access-x9ltg\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.744291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.744266 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-credential-socket\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.844846 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.844813 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-credential-socket\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845007 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.844864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-socket\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845007 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.844917 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-certs\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845007 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.844951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-data\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845007 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.844977 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-podinfo\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845007 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-envoy\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845305 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-token\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845305 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istiod-ca-cert\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845305 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845085 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9ltg\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-kube-api-access-x9ltg\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845305 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845289 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-socket\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845503 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845319 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-credential-socket\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845503 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845368 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-certs\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845633 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845612 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-data\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.845924 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.845904 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istiod-ca-cert\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.847619 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.847598 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-envoy\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.847619 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.847604 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-podinfo\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.854706 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.854679 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-token\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:05.855298 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:05.855280 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9ltg\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-kube-api-access-x9ltg\") pod \"e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:06.020652 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.020620 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:06.157863 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.157841 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28"] Jul 06 20:02:06.159843 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:02:06.159811 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef8c301_2d7d_40d0_bb37_1cdbebb5252e.slice/crio-a989289b43e9f44d47327ea23f85f548de7856755d47847423e4a1f878552979 WatchSource:0}: Error finding container a989289b43e9f44d47327ea23f85f548de7856755d47847423e4a1f878552979: Status 404 returned error can't find the container with id a989289b43e9f44d47327ea23f85f548de7856755d47847423e4a1f878552979 Jul 06 20:02:06.161954 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.161923 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:06.162048 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.161989 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:06.162048 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.162039 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:06.374402 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.374309 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-997fb599d-4m269"] Jul 06 20:02:06.374745 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.374730 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" Jul 06 20:02:06.374788 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.374748 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb37066-74ed-4015-803d-cc3db621588e" containerName="istio-proxy" Jul 06 20:02:06.378125 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.378108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.399708 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.399679 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-997fb599d-4m269"] Jul 06 20:02:06.451981 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.451952 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-config\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.452161 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.452015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-service-ca\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.452161 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.452073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-oauth-config\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.452161 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.452111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-oauth-serving-cert\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.452161 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.452133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-trusted-ca-bundle\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.452161 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.452148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6qzt\" (UniqueName: \"kubernetes.io/projected/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-kube-api-access-t6qzt\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.452350 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.452209 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-serving-cert\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553629 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-config\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553797 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-service-ca\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553797 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-oauth-config\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553926 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553817 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-oauth-serving-cert\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553926 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553843 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-trusted-ca-bundle\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553926 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553859 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6qzt\" (UniqueName: \"kubernetes.io/projected/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-kube-api-access-t6qzt\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.553926 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.553914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-serving-cert\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.554456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.554427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-config\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.554589 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.554481 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-service-ca\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.554589 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.554497 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-oauth-serving-cert\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.554731 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.554713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-trusted-ca-bundle\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.556154 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.556134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-oauth-config\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.556342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.556326 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-console-serving-cert\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.563770 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.563749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6qzt\" (UniqueName: \"kubernetes.io/projected/aa5c8980-06e4-4ec0-aae6-6b1f69ee6182-kube-api-access-t6qzt\") pod \"console-997fb599d-4m269\" (UID: \"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182\") " pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.570894 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.570870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" event={"ID":"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e","Type":"ContainerStarted","Data":"d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630"} Jul 06 20:02:06.570994 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.570927 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" event={"ID":"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e","Type":"ContainerStarted","Data":"a989289b43e9f44d47327ea23f85f548de7856755d47847423e4a1f878552979"} Jul 06 20:02:06.596246 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.596195 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podStartSLOduration=1.596180878 podStartE2EDuration="1.596180878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:06.594206732 +0000 UTC m=+2216.472345464" watchObservedRunningTime="2026-07-06 20:02:06.596180878 +0000 UTC m=+2216.474319606" Jul 06 20:02:06.688113 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.688019 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:06.830011 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:06.829975 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-997fb599d-4m269"] Jul 06 20:02:06.833791 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:02:06.833766 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5c8980_06e4_4ec0_aae6_6b1f69ee6182.slice/crio-356f160d53348877f396229e80af363fb262fbb2dc6c7ba206912a4e311f14bf WatchSource:0}: Error finding container 356f160d53348877f396229e80af363fb262fbb2dc6c7ba206912a4e311f14bf: Status 404 returned error can't find the container with id 356f160d53348877f396229e80af363fb262fbb2dc6c7ba206912a4e311f14bf Jul 06 20:02:07.021202 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.021169 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:07.025553 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.025531 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:07.578011 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.577974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-997fb599d-4m269" event={"ID":"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182","Type":"ContainerStarted","Data":"c8b04542b817ebd92eb94d3602d301632b2570c06d35fef08f7aa2141c714934"} Jul 06 20:02:07.578201 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.578020 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-997fb599d-4m269" event={"ID":"aa5c8980-06e4-4ec0-aae6-6b1f69ee6182","Type":"ContainerStarted","Data":"356f160d53348877f396229e80af363fb262fbb2dc6c7ba206912a4e311f14bf"} Jul 06 20:02:07.578266 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.578256 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:07.579220 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.579199 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:07.597234 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:07.597159 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-997fb599d-4m269" podStartSLOduration=1.597141722 podStartE2EDuration="1.597141722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:07.596758768 +0000 UTC m=+2217.474897497" watchObservedRunningTime="2026-07-06 20:02:07.597141722 +0000 UTC m=+2217.475280452" Jul 06 20:02:13.671211 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.671178 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8"] Jul 06 20:02:13.675239 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.675221 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.680704 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.680687 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fc607d-openshift-default-dockercfg-m5klr\"" Jul 06 20:02:13.725498 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-certs\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-token\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzrc\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-kube-api-access-8rzrc\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-envoy\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725766 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-credential-socket\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725766 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725696 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-socket\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725766 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725717 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-podinfo\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725860 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fff4826-3a73-4238-9bab-85feb70c30ff-istiod-ca-cert\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.725860 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.725811 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-data\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.743510 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.743483 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8"] Jul 06 20:02:13.827135 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-certs\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827135 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-token\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827159 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzrc\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-kube-api-access-8rzrc\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827196 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-envoy\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-credential-socket\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-socket\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-podinfo\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827591 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827484 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fff4826-3a73-4238-9bab-85feb70c30ff-istiod-ca-cert\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827591 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-data\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827591 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827561 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-certs\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827754 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827684 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-credential-socket\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827813 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827757 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-socket\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.827852 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.827818 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-data\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.828241 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.828220 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fff4826-3a73-4238-9bab-85feb70c30ff-istiod-ca-cert\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.829615 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.829589 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-envoy\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.829740 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.829723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-podinfo\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.836491 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.836466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-token\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.837025 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.837005 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzrc\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-kube-api-access-8rzrc\") pod \"e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:13.986708 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:13.986630 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:14.143556 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.143533 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8"] Jul 06 20:02:14.145490 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:02:14.145458 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fff4826_3a73_4238_9bab_85feb70c30ff.slice/crio-b6e633285b7dfbb530eda3b47ac930d4ac8a515107609ab0af3fa6f24cceb021 WatchSource:0}: Error finding container b6e633285b7dfbb530eda3b47ac930d4ac8a515107609ab0af3fa6f24cceb021: Status 404 returned error can't find the container with id b6e633285b7dfbb530eda3b47ac930d4ac8a515107609ab0af3fa6f24cceb021 Jul 06 20:02:14.147596 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.147565 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:14.147688 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.147638 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:14.147688 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.147680 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:14.617858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.617814 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" event={"ID":"4fff4826-3a73-4238-9bab-85feb70c30ff","Type":"ContainerStarted","Data":"e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628"} Jul 06 20:02:14.617858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.617865 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" event={"ID":"4fff4826-3a73-4238-9bab-85feb70c30ff","Type":"ContainerStarted","Data":"b6e633285b7dfbb530eda3b47ac930d4ac8a515107609ab0af3fa6f24cceb021"} Jul 06 20:02:14.644588 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.644543 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podStartSLOduration=1.644528384 podStartE2EDuration="1.644528384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:14.642273389 +0000 UTC m=+2224.520412130" watchObservedRunningTime="2026-07-06 20:02:14.644528384 +0000 UTC m=+2224.522667112" Jul 06 20:02:14.987853 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:14.987769 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:15.991945 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:15.991915 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:16.543443 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:16.543409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:02:16.628893 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:16.628864 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:16.629826 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:16.629806 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:16.688425 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:16.688370 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:16.688700 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:16.688679 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:16.694277 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:16.694253 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:17.647049 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:17.647013 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-997fb599d-4m269" Jul 06 20:02:17.716028 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:17.715996 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb67f64b5-j7x5n"] Jul 06 20:02:23.619566 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:23.619527 2555 patch_prober.go:28] interesting pod/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 20:02:23.620111 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:23.619607 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 20:02:24.680242 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:24.680149 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerID="d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630" exitCode=0 Jul 06 20:02:24.680242 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:24.680222 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" event={"ID":"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e","Type":"ContainerDied","Data":"d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630"} Jul 06 20:02:24.680672 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:24.680639 2555 scope.go:117] "RemoveContainer" containerID="d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630" Jul 06 20:02:24.681664 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:24.681636 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:24.681733 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:24.681719 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:24.681772 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:24.681754 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:25.687699 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:25.687665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" event={"ID":"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e","Type":"ContainerStarted","Data":"1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba"} Jul 06 20:02:26.020781 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:26.020744 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:26.021084 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:26.021065 2555 patch_prober.go:28] interesting pod/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 20:02:26.021159 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:26.021116 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 20:02:27.021550 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:27.021510 2555 patch_prober.go:28] interesting pod/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 20:02:27.022001 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:27.021576 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 20:02:27.602504 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:27.602472 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:02:28.021430 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:28.021382 2555 patch_prober.go:28] interesting pod/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 20:02:28.021611 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:28.021456 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 20:02:29.021832 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:29.021789 2555 patch_prober.go:28] interesting pod/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 20:02:29.022215 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:29.021862 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 20:02:30.024979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:30.024937 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:30.025368 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:30.025333 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:30.025948 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:30.025928 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:02:31.630807 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.630772 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 20:02:31.631273 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.630836 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 20:02:31.720580 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.720554 2555 generic.go:356] "Generic (PLEG): container finished" podID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerID="e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628" exitCode=0 Jul 06 20:02:31.720730 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.720626 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" event={"ID":"4fff4826-3a73-4238-9bab-85feb70c30ff","Type":"ContainerDied","Data":"e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628"} Jul 06 20:02:31.721085 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.721067 2555 scope.go:117] "RemoveContainer" containerID="e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628" Jul 06 20:02:31.722025 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.721998 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:31.722105 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.722063 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:31.722105 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:31.722099 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:02:32.726459 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:32.726358 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" event={"ID":"4fff4826-3a73-4238-9bab-85feb70c30ff","Type":"ContainerStarted","Data":"ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3"} Jul 06 20:02:32.987827 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:32.987750 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:32.987996 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:32.987975 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 20:02:32.988040 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:32.988022 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 20:02:33.987955 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:33.987920 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 20:02:33.988342 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:33.987974 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 20:02:34.987291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:34.987253 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 20:02:34.987522 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:34.987309 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 20:02:35.987072 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:35.987040 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 20:02:35.987496 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:35.987093 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 20:02:36.990892 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:36.990857 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:36.991284 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:36.991205 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:36.991860 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:36.991842 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:02:39.814934 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:39.814900 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:02:42.764695 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:42.764632 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cb67f64b5-j7x5n" podUID="867766dd-f4e3-4881-a759-bf604862d15a" containerName="console" containerID="cri-o://2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037" gracePeriod=15 Jul 06 20:02:43.022586 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.022529 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 20:02:43.135356 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135325 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-oauth-serving-cert\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135526 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135376 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-console-config\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135526 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135426 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-service-ca\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135649 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135539 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-serving-cert\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135649 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135624 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-trusted-ca-bundle\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135767 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135683 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl2n6\" (UniqueName: \"kubernetes.io/projected/867766dd-f4e3-4881-a759-bf604862d15a-kube-api-access-pl2n6\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135767 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135733 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-oauth-config\") pod \"867766dd-f4e3-4881-a759-bf604862d15a\" (UID: \"867766dd-f4e3-4881-a759-bf604862d15a\") " Jul 06 20:02:43.135871 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135758 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:02:43.135871 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135779 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-service-ca" (OuterVolumeSpecName: "service-ca") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:02:43.135871 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.135809 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-console-config" (OuterVolumeSpecName: "console-config") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:02:43.136051 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.136027 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:02:43.136108 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.136095 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-oauth-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.136147 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.136115 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-console-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.136147 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.136130 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.137403 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.137364 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:02:43.137646 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.137629 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:02:43.137811 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.137790 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867766dd-f4e3-4881-a759-bf604862d15a-kube-api-access-pl2n6" (OuterVolumeSpecName: "kube-api-access-pl2n6") pod "867766dd-f4e3-4881-a759-bf604862d15a" (UID: "867766dd-f4e3-4881-a759-bf604862d15a"). InnerVolumeSpecName "kube-api-access-pl2n6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:02:43.236537 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.236509 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl2n6\" (UniqueName: \"kubernetes.io/projected/867766dd-f4e3-4881-a759-bf604862d15a-kube-api-access-pl2n6\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.236537 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.236535 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-oauth-config\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.236692 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.236548 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/867766dd-f4e3-4881-a759-bf604862d15a-console-serving-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.236692 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.236561 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867766dd-f4e3-4881-a759-bf604862d15a-trusted-ca-bundle\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:02:43.795188 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.795156 2555 generic.go:356] "Generic (PLEG): container finished" podID="867766dd-f4e3-4881-a759-bf604862d15a" containerID="2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037" exitCode=0 Jul 06 20:02:43.795615 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.795200 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb67f64b5-j7x5n" Jul 06 20:02:43.795615 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.795238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb67f64b5-j7x5n" event={"ID":"867766dd-f4e3-4881-a759-bf604862d15a","Type":"ContainerDied","Data":"2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037"} Jul 06 20:02:43.795615 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.795285 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb67f64b5-j7x5n" event={"ID":"867766dd-f4e3-4881-a759-bf604862d15a","Type":"ContainerDied","Data":"f13964691234798cf28998c9f5e077206fc9aebd334d1a0ed0a8dbaae18ef345"} Jul 06 20:02:43.795615 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.795305 2555 scope.go:117] "RemoveContainer" containerID="2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037" Jul 06 20:02:43.804467 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.804444 2555 scope.go:117] "RemoveContainer" containerID="2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037" Jul 06 20:02:43.804732 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:02:43.804714 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037\": container with ID starting with 2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037 not found: ID does not exist" containerID="2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037" Jul 06 20:02:43.804780 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.804740 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037"} err="failed to get container status \"2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037\": rpc error: code = NotFound desc = could not find container \"2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037\": container with ID starting with 2b3a5b2e077f2a7719ae0142360c544f331b670d87686419ccd51998aee8f037 not found: ID does not exist" Jul 06 20:02:43.820150 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.820127 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb67f64b5-j7x5n"] Jul 06 20:02:43.824612 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.824591 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb67f64b5-j7x5n"] Jul 06 20:02:43.850971 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:02:43.850949 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867766dd-f4e3-4881-a759-bf604862d15a" path="/var/lib/kubelet/pods/867766dd-f4e3-4881-a759-bf604862d15a/volumes" Jul 06 20:03:19.534621 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:03:19.534587 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:04:05.802420 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:04:05.802307 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:04:19.403812 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:04:19.403782 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:05:00.108032 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:00.108002 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28"] Jul 06 20:05:00.108556 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:00.108201 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" containerID="cri-o://1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba" gracePeriod=30 Jul 06 20:05:04.614743 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:04.614704 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:05:05.358700 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.358675 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:05:05.436716 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436633 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-token\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436716 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436677 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-podinfo\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436716 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436707 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-envoy\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436734 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-socket\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436768 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istiod-ca-cert\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436801 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9ltg\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-kube-api-access-x9ltg\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436827 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-certs\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436860 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-credential-socket\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.436979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.436882 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-data\") pod \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\" (UID: \"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e\") " Jul 06 20:05:05.437291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437063 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:05.437291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437141 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:05.437291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437206 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:05:05.437291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437270 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.437291 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437292 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.437570 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437464 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:05.437953 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.437931 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:05.438884 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.438856 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:05:05.439317 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.439288 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:05.439435 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.439343 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:05.439435 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.439348 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-kube-api-access-x9ltg" (OuterVolumeSpecName: "kube-api-access-x9ltg") pod "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" (UID: "9ef8c301-2d7d-40d0-bb37-1cdbebb5252e"). InnerVolumeSpecName "kube-api-access-x9ltg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:05.461065 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.461036 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerID="1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba" exitCode=0 Jul 06 20:05:05.461203 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.461084 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" Jul 06 20:05:05.461203 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.461112 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" event={"ID":"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e","Type":"ContainerDied","Data":"1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba"} Jul 06 20:05:05.461203 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.461161 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28" event={"ID":"9ef8c301-2d7d-40d0-bb37-1cdbebb5252e","Type":"ContainerDied","Data":"a989289b43e9f44d47327ea23f85f548de7856755d47847423e4a1f878552979"} Jul 06 20:05:05.461203 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.461182 2555 scope.go:117] "RemoveContainer" containerID="1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba" Jul 06 20:05:05.470340 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.470322 2555 scope.go:117] "RemoveContainer" containerID="d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630" Jul 06 20:05:05.477701 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.477687 2555 scope.go:117] "RemoveContainer" containerID="1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba" Jul 06 20:05:05.477949 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:05.477931 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba\": container with ID starting with 1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba not found: ID does not exist" containerID="1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba" Jul 06 20:05:05.477991 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.477957 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba"} err="failed to get container status \"1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba\": rpc error: code = NotFound desc = could not find container \"1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba\": container with ID starting with 1e7cdb9420a90c26dd847735e27376cf575eacb05133237d1d6d60c593f9f7ba not found: ID does not exist" Jul 06 20:05:05.477991 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.477973 2555 scope.go:117] "RemoveContainer" containerID="d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630" Jul 06 20:05:05.478190 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:05.478175 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630\": container with ID starting with d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630 not found: ID does not exist" containerID="d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630" Jul 06 20:05:05.478233 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.478193 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630"} err="failed to get container status \"d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630\": rpc error: code = NotFound desc = could not find container \"d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630\": container with ID starting with d73ee53bb3f46f7cc88951a9df3559f6628ae1631f6b787a2a8c7cd6cfe41630 not found: ID does not exist" Jul 06 20:05:05.496972 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.496949 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28"] Jul 06 20:05:05.514095 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.514072 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-749ce0-openshift-default-76b7d79cb5-w9j28"] Jul 06 20:05:05.537723 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537700 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.537803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537724 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.537803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537735 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.537803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537742 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.537803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537751 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.537803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537758 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.537803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.537766 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9ltg\" (UniqueName: \"kubernetes.io/projected/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e-kube-api-access-x9ltg\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:05.851353 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:05.851316 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" path="/var/lib/kubelet/pods/9ef8c301-2d7d-40d0-bb37-1cdbebb5252e/volumes" Jul 06 20:05:08.433452 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:08.433416 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8"] Jul 06 20:05:08.433823 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:08.433616 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" containerID="cri-o://ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3" gracePeriod=30 Jul 06 20:05:09.356780 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.356749 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x"] Jul 06 20:05:09.357115 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.357103 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" Jul 06 20:05:09.357156 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.357118 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" Jul 06 20:05:09.357156 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.357135 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867766dd-f4e3-4881-a759-bf604862d15a" containerName="console" Jul 06 20:05:09.357156 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.357141 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="867766dd-f4e3-4881-a759-bf604862d15a" containerName="console" Jul 06 20:05:09.357263 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.357199 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="867766dd-f4e3-4881-a759-bf604862d15a" containerName="console" Jul 06 20:05:09.357263 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.357207 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" Jul 06 20:05:09.361659 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.361643 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.363771 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.363753 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-dcc969-openshift-default-dockercfg-hct2x\"" Jul 06 20:05:09.366863 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.366839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istiod-ca-cert\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.366973 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.366874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-certs\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.366973 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.366901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p2kx\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-kube-api-access-6p2kx\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.366973 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.366965 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-podinfo\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.367082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.366988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-data\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.367082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.367017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-envoy\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.367082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.367048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-token\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.367082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.367077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-credential-socket\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.367265 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.367101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-socket\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.376822 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.376794 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x"] Jul 06 20:05:09.467601 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467566 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-podinfo\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.467601 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-data\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-envoy\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467677 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-token\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-credential-socket\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-socket\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istiod-ca-cert\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.467826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-certs\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.468033 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-data\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468107 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.468049 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2kx\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-kube-api-access-6p2kx\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468506 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.468225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-certs\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468506 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.468274 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-credential-socket\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468506 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.468327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-socket\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.468614 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.468562 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istiod-ca-cert\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.469961 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.469938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-envoy\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.470070 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.470041 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-podinfo\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.482002 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.481981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p2kx\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-kube-api-access-6p2kx\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.482114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.482087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-token\") pod \"e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.671299 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.671211 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:09.812769 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.812742 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x"] Jul 06 20:05:09.814338 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:05:09.814315 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31ee3a9_2622_4dd4_b4e5_6b34aa7d7f54.slice/crio-7f0de3be5a82235f64e049af290dfae4c9936c8e798b8b197e829f13fb525efd WatchSource:0}: Error finding container 7f0de3be5a82235f64e049af290dfae4c9936c8e798b8b197e829f13fb525efd: Status 404 returned error can't find the container with id 7f0de3be5a82235f64e049af290dfae4c9936c8e798b8b197e829f13fb525efd Jul 06 20:05:09.816348 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.816321 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:09.816440 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.816381 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:09.816440 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:09.816427 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:10.488445 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:10.488407 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" event={"ID":"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54","Type":"ContainerStarted","Data":"8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221"} Jul 06 20:05:10.488823 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:10.488471 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" event={"ID":"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54","Type":"ContainerStarted","Data":"7f0de3be5a82235f64e049af290dfae4c9936c8e798b8b197e829f13fb525efd"} Jul 06 20:05:10.519722 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:10.519662 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podStartSLOduration=1.5196410409999999 podStartE2EDuration="1.519641041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:10.518922388 +0000 UTC m=+2400.397061122" watchObservedRunningTime="2026-07-06 20:05:10.519641041 +0000 UTC m=+2400.397779769" Jul 06 20:05:10.671931 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:10.671899 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:10.676587 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:10.676563 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:11.492990 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:11.492965 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:11.493968 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:11.493952 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:13.683738 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.683706 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:05:13.706284 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706217 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-token\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706284 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706245 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-socket\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706284 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706271 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rzrc\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-kube-api-access-8rzrc\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706294 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-envoy\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706334 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-data\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706383 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fff4826-3a73-4238-9bab-85feb70c30ff-istiod-ca-cert\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706447 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-podinfo\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706476 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-credential-socket\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706499 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-certs\") pod \"4fff4826-3a73-4238-9bab-85feb70c30ff\" (UID: \"4fff4826-3a73-4238-9bab-85feb70c30ff\") " Jul 06 20:05:13.706534 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706498 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:13.706875 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706690 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:13.706875 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706751 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fff4826-3a73-4238-9bab-85feb70c30ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:05:13.706875 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706852 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.707033 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706880 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fff4826-3a73-4238-9bab-85feb70c30ff-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.707033 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706879 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:13.707033 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.706895 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.707425 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.707373 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:13.708645 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.708611 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:05:13.708751 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.708717 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:13.708751 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.708731 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-kube-api-access-8rzrc" (OuterVolumeSpecName: "kube-api-access-8rzrc") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "kube-api-access-8rzrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:13.708751 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.708720 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "4fff4826-3a73-4238-9bab-85feb70c30ff" (UID: "4fff4826-3a73-4238-9bab-85feb70c30ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:13.807660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.807629 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.807660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.807657 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.807660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.807666 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.807891 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.807673 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.807891 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.807682 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rzrc\" (UniqueName: \"kubernetes.io/projected/4fff4826-3a73-4238-9bab-85feb70c30ff-kube-api-access-8rzrc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:13.807891 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:13.807691 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fff4826-3a73-4238-9bab-85feb70c30ff-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:14.509163 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.509130 2555 generic.go:356] "Generic (PLEG): container finished" podID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerID="ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3" exitCode=0 Jul 06 20:05:14.509357 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.509179 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" Jul 06 20:05:14.509357 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.509205 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" event={"ID":"4fff4826-3a73-4238-9bab-85feb70c30ff","Type":"ContainerDied","Data":"ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3"} Jul 06 20:05:14.509357 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.509254 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8" event={"ID":"4fff4826-3a73-4238-9bab-85feb70c30ff","Type":"ContainerDied","Data":"b6e633285b7dfbb530eda3b47ac930d4ac8a515107609ab0af3fa6f24cceb021"} Jul 06 20:05:14.509357 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.509275 2555 scope.go:117] "RemoveContainer" containerID="ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3" Jul 06 20:05:14.517972 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.517953 2555 scope.go:117] "RemoveContainer" containerID="e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628" Jul 06 20:05:14.525254 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.525228 2555 scope.go:117] "RemoveContainer" containerID="ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3" Jul 06 20:05:14.525532 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:14.525514 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3\": container with ID starting with ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3 not found: ID does not exist" containerID="ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3" Jul 06 20:05:14.525586 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.525540 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3"} err="failed to get container status \"ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3\": rpc error: code = NotFound desc = could not find container \"ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3\": container with ID starting with ae71a38e4786559e23d92e1617c19895bf1700a313a976f7a4c751f6f4fb28a3 not found: ID does not exist" Jul 06 20:05:14.525586 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.525559 2555 scope.go:117] "RemoveContainer" containerID="e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628" Jul 06 20:05:14.525794 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:14.525780 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628\": container with ID starting with e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628 not found: ID does not exist" containerID="e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628" Jul 06 20:05:14.525838 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.525797 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628"} err="failed to get container status \"e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628\": rpc error: code = NotFound desc = could not find container \"e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628\": container with ID starting with e4ef7bcb89fd5ee812124ee41630a48cb15c4d3b4f27dd02fb260abe998ab628 not found: ID does not exist" Jul 06 20:05:14.552836 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.552808 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8"] Jul 06 20:05:14.564234 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:14.564204 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fc607d-openshift-default-7d4cf45cff-h4rd8"] Jul 06 20:05:15.850219 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:15.850183 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" path="/var/lib/kubelet/pods/4fff4826-3a73-4238-9bab-85feb70c30ff/volumes" Jul 06 20:05:17.774637 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.774608 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f"] Jul 06 20:05:17.775010 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.774978 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" Jul 06 20:05:17.775010 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.774991 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" Jul 06 20:05:17.775010 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.775000 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" Jul 06 20:05:17.775010 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.775005 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" Jul 06 20:05:17.775139 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.775078 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" Jul 06 20:05:17.775139 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.775090 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" Jul 06 20:05:17.775139 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.775099 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef8c301-2d7d-40d0-bb37-1cdbebb5252e" containerName="istio-proxy" Jul 06 20:05:17.778096 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.778081 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.780219 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.780199 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ba1024-openshift-default-dockercfg-qpvnh\"" Jul 06 20:05:17.792547 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.792525 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f"] Jul 06 20:05:17.845731 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845706 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-certs\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.845863 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845741 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g22lr\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-kube-api-access-g22lr\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.845863 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-socket\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.845863 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19456308-bd94-4617-93d3-75d56533cb41-istiod-ca-cert\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.845863 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-istio-token\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.846087 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-credential-socket\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.846087 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-envoy\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.846087 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19456308-bd94-4617-93d3-75d56533cb41-istio-podinfo\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.846087 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.845972 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-data\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.901982 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.901949 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:05:17.947081 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947048 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-credential-socket\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947257 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947120 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-envoy\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947257 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19456308-bd94-4617-93d3-75d56533cb41-istio-podinfo\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947257 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947173 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-data\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947257 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947216 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-certs\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947257 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947252 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g22lr\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-kube-api-access-g22lr\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947542 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-socket\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947542 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19456308-bd94-4617-93d3-75d56533cb41-istiod-ca-cert\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947542 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-istio-token\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947697 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-certs\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947847 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947820 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-socket\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.947914 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.947842 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-credential-socket\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.948131 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.948113 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-data\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.948261 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.948240 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19456308-bd94-4617-93d3-75d56533cb41-istiod-ca-cert\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.949615 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.949594 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-envoy\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.949819 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.949801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19456308-bd94-4617-93d3-75d56533cb41-istio-podinfo\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.956431 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.956379 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-istio-token\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:17.956620 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:17.956602 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g22lr\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-kube-api-access-g22lr\") pod \"e2e-api-b-ba1024-openshift-default-749df94465-nn78f\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:18.089580 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.089520 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:18.244746 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:05:18.244717 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19456308_bd94_4617_93d3_75d56533cb41.slice/crio-01390dcdc28c1a756ae95fa7c2877acaf7887402251db522ee2564973c84ac0c WatchSource:0}: Error finding container 01390dcdc28c1a756ae95fa7c2877acaf7887402251db522ee2564973c84ac0c: Status 404 returned error can't find the container with id 01390dcdc28c1a756ae95fa7c2877acaf7887402251db522ee2564973c84ac0c Jul 06 20:05:18.247436 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.247375 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:18.247570 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.247482 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:18.247570 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.247527 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:18.248295 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.248275 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f"] Jul 06 20:05:18.530878 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.530847 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" event={"ID":"19456308-bd94-4617-93d3-75d56533cb41","Type":"ContainerStarted","Data":"0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083"} Jul 06 20:05:18.531051 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.530895 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" event={"ID":"19456308-bd94-4617-93d3-75d56533cb41","Type":"ContainerStarted","Data":"01390dcdc28c1a756ae95fa7c2877acaf7887402251db522ee2564973c84ac0c"} Jul 06 20:05:18.553466 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:18.553412 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podStartSLOduration=1.553377521 podStartE2EDuration="1.553377521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:18.553267971 +0000 UTC m=+2408.431406699" watchObservedRunningTime="2026-07-06 20:05:18.553377521 +0000 UTC m=+2408.431516250" Jul 06 20:05:19.090186 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:19.090147 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:19.095028 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:19.095002 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:19.539588 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:19.539556 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:19.544784 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:19.544757 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:26.494589 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.494551 2555 patch_prober.go:28] interesting pod/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 20:05:26.495052 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.494612 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 20:05:26.578090 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.578055 2555 generic.go:356] "Generic (PLEG): container finished" podID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerID="8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221" exitCode=0 Jul 06 20:05:26.578239 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.578125 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" event={"ID":"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54","Type":"ContainerDied","Data":"8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221"} Jul 06 20:05:26.578569 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.578555 2555 scope.go:117] "RemoveContainer" containerID="8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221" Jul 06 20:05:26.579523 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.579495 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:26.579625 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.579560 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:26.579625 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:26.579596 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:27.591469 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:27.591430 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" event={"ID":"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54","Type":"ContainerStarted","Data":"928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895"} Jul 06 20:05:27.672120 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:27.672080 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:27.672352 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:27.672332 2555 patch_prober.go:28] interesting pod/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 20:05:27.672435 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:27.672415 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 20:05:28.306699 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:28.306666 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:05:28.672307 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:28.672224 2555 patch_prober.go:28] interesting pod/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 20:05:28.672307 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:28.672289 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 20:05:29.672250 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:29.672206 2555 patch_prober.go:28] interesting pod/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 20:05:29.672619 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:29.672586 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 20:05:30.671900 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:30.671863 2555 patch_prober.go:28] interesting pod/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 20:05:30.672194 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:30.672167 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 20:05:31.698911 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:31.698883 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:31.699464 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:31.699338 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:31.701504 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:31.701486 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:35.581559 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:35.581523 2555 patch_prober.go:28] interesting pod/e2e-api-b-ba1024-openshift-default-749df94465-nn78f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 20:05:35.581928 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:35.581587 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 20:05:36.635172 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:36.635141 2555 generic.go:356] "Generic (PLEG): container finished" podID="19456308-bd94-4617-93d3-75d56533cb41" containerID="0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083" exitCode=0 Jul 06 20:05:36.635599 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:36.635214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" event={"ID":"19456308-bd94-4617-93d3-75d56533cb41","Type":"ContainerDied","Data":"0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083"} Jul 06 20:05:36.635666 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:36.635645 2555 scope.go:117] "RemoveContainer" containerID="0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083" Jul 06 20:05:36.636748 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:36.636718 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:36.636813 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:36.636788 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:36.636849 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:36.636824 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:37.642670 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:37.642638 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" event={"ID":"19456308-bd94-4617-93d3-75d56533cb41","Type":"ContainerStarted","Data":"086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c"} Jul 06 20:05:38.090427 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:38.090371 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:38.090653 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:38.090630 2555 patch_prober.go:28] interesting pod/e2e-api-b-ba1024-openshift-default-749df94465-nn78f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:05:38.090710 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:38.090689 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 20:05:39.089875 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:39.089840 2555 patch_prober.go:28] interesting pod/e2e-api-b-ba1024-openshift-default-749df94465-nn78f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:05:39.090334 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:39.089899 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 20:05:39.723058 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:39.723029 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:05:40.090123 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:40.090089 2555 patch_prober.go:28] interesting pod/e2e-api-b-ba1024-openshift-default-749df94465-nn78f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:05:40.090532 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:40.090156 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 20:05:40.571532 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:40.571496 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x"] Jul 06 20:05:40.571806 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:40.571778 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" containerID="cri-o://928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895" gracePeriod=30 Jul 06 20:05:41.090749 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:41.090715 2555 patch_prober.go:28] interesting pod/e2e-api-b-ba1024-openshift-default-749df94465-nn78f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:05:41.091118 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:41.090766 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 20:05:42.093537 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:42.093507 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:42.093970 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:42.093832 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:42.094710 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:42.094688 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:45.836186 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.836133 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:45.932227 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932196 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-envoy\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932373 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932239 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-credential-socket\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932373 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932282 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-podinfo\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932373 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932310 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-certs\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932373 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932344 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p2kx\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-kube-api-access-6p2kx\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932635 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932523 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-token\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932635 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932575 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-data\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932635 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932615 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istiod-ca-cert\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.932802 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932634 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:45.932802 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932649 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:45.932995 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.932977 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-socket\") pod \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\" (UID: \"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54\") " Jul 06 20:05:45.933290 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933008 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:05:45.933290 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933253 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:45.933446 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933364 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-data" (OuterVolumeSpecName: "istio-data") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:45.933700 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933680 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:45.933741 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933706 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:45.933741 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933721 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:45.933741 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933733 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:45.933834 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.933747 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:45.934650 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.934625 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-token" (OuterVolumeSpecName: "istio-token") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:45.934747 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.934721 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:05:45.934919 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.934896 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-kube-api-access-6p2kx" (OuterVolumeSpecName: "kube-api-access-6p2kx") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "kube-api-access-6p2kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:45.934981 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:45.934899 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" (UID: "b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:46.034876 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.034828 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p2kx\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-kube-api-access-6p2kx\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:46.034876 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.034870 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:46.034876 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.034879 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:46.034876 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.034889 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:46.690826 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.690789 2555 generic.go:356] "Generic (PLEG): container finished" podID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerID="928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895" exitCode=0 Jul 06 20:05:46.691024 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.690830 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" event={"ID":"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54","Type":"ContainerDied","Data":"928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895"} Jul 06 20:05:46.691024 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.690878 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" Jul 06 20:05:46.691024 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.690926 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x" event={"ID":"b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54","Type":"ContainerDied","Data":"7f0de3be5a82235f64e049af290dfae4c9936c8e798b8b197e829f13fb525efd"} Jul 06 20:05:46.691024 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.690959 2555 scope.go:117] "RemoveContainer" containerID="928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895" Jul 06 20:05:46.700720 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.700703 2555 scope.go:117] "RemoveContainer" containerID="8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221" Jul 06 20:05:46.708086 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.708067 2555 scope.go:117] "RemoveContainer" containerID="928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895" Jul 06 20:05:46.708320 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:46.708302 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895\": container with ID starting with 928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895 not found: ID does not exist" containerID="928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895" Jul 06 20:05:46.708373 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.708326 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895"} err="failed to get container status \"928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895\": rpc error: code = NotFound desc = could not find container \"928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895\": container with ID starting with 928dd3802fd8d478d87bb4a57f817a2164e05af678a1a4d4e52649fb7a70c895 not found: ID does not exist" Jul 06 20:05:46.708373 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.708341 2555 scope.go:117] "RemoveContainer" containerID="8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221" Jul 06 20:05:46.708567 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:46.708549 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221\": container with ID starting with 8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221 not found: ID does not exist" containerID="8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221" Jul 06 20:05:46.708622 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.708577 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221"} err="failed to get container status \"8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221\": rpc error: code = NotFound desc = could not find container \"8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221\": container with ID starting with 8cd9f537595cc8385649a16420d816a6c0929bcb41a92d5af04c4a42baf33221 not found: ID does not exist" Jul 06 20:05:46.723181 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.723160 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x"] Jul 06 20:05:46.729374 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:46.729352 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-dcc969-openshift-default-5497f67779-4cs9x"] Jul 06 20:05:47.850725 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:47.850696 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" path="/var/lib/kubelet/pods/b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54/volumes" Jul 06 20:05:48.690671 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:48.690640 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f"] Jul 06 20:05:48.690907 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:48.690882 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" containerID="cri-o://086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c" gracePeriod=30 Jul 06 20:05:49.659500 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659467 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4"] Jul 06 20:05:49.659858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659800 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" Jul 06 20:05:49.659858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659812 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" Jul 06 20:05:49.659858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659824 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" Jul 06 20:05:49.659858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659829 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fff4826-3a73-4238-9bab-85feb70c30ff" containerName="istio-proxy" Jul 06 20:05:49.659858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659845 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" Jul 06 20:05:49.659858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659851 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" Jul 06 20:05:49.660044 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659904 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" Jul 06 20:05:49.660044 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.659913 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31ee3a9-2622-4dd4-b4e5-6b34aa7d7f54" containerName="istio-proxy" Jul 06 20:05:49.662673 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.662656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.665363 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.665335 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7ba461-openshift-default-dockercfg-ghlc5\"" Jul 06 20:05:49.683413 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.683371 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4"] Jul 06 20:05:49.765655 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pcj\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-kube-api-access-r4pcj\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765655 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765658 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-certs\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765868 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-envoy\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765868 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istiod-ca-cert\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765868 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-token\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765868 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765754 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-socket\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765868 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-data\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.765868 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-podinfo\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.766059 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.765893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-credential-socket\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866573 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pcj\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-kube-api-access-r4pcj\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866573 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866575 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-certs\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866815 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866601 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-envoy\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866815 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866722 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istiod-ca-cert\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866815 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-token\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866815 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866786 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-socket\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.866815 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-data\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-podinfo\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866904 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-credential-socket\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867082 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.866979 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-certs\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867239 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.867179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-data\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867308 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.867245 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-credential-socket\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867308 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.867287 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-socket\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.867440 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.867421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istiod-ca-cert\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.868785 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.868768 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-envoy\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.869232 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.869207 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-podinfo\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.875649 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.875628 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-token\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.876287 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.876264 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pcj\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-kube-api-access-r4pcj\") pod \"e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:49.973355 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:49.973293 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:50.120803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.120781 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4"] Jul 06 20:05:50.122944 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:05:50.122916 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06ee9da_2e94_4cb0_a45e_946d9c61815d.slice/crio-50e754d02e39efc5d3af9f530fc00013e72de710a672aabed016183f5c8f5744 WatchSource:0}: Error finding container 50e754d02e39efc5d3af9f530fc00013e72de710a672aabed016183f5c8f5744: Status 404 returned error can't find the container with id 50e754d02e39efc5d3af9f530fc00013e72de710a672aabed016183f5c8f5744 Jul 06 20:05:50.125565 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.125534 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:50.125650 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.125598 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:50.125650 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.125624 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:50.711562 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.711526 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" event={"ID":"b06ee9da-2e94-4cb0-a45e-946d9c61815d","Type":"ContainerStarted","Data":"92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5"} Jul 06 20:05:50.711981 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.711596 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" event={"ID":"b06ee9da-2e94-4cb0-a45e-946d9c61815d","Type":"ContainerStarted","Data":"50e754d02e39efc5d3af9f530fc00013e72de710a672aabed016183f5c8f5744"} Jul 06 20:05:50.744433 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.744363 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podStartSLOduration=1.744347357 podStartE2EDuration="1.744347357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:50.744114229 +0000 UTC m=+2440.622252956" watchObservedRunningTime="2026-07-06 20:05:50.744347357 +0000 UTC m=+2440.622486086" Jul 06 20:05:50.974378 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:50.974306 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:51.316158 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:51.316126 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:05:51.978443 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:51.978414 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:52.720051 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:52.720018 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:52.721028 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:52.721010 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:05:53.949774 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:53.949709 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:54.004941 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.004910 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-data\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.004941 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.004942 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-certs\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.004970 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19456308-bd94-4617-93d3-75d56533cb41-istio-podinfo\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005005 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19456308-bd94-4617-93d3-75d56533cb41-istiod-ca-cert\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005045 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-envoy\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005084 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-credential-socket\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005336 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005113 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-istio-token\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005336 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005156 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g22lr\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-kube-api-access-g22lr\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005336 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005194 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-socket\") pod \"19456308-bd94-4617-93d3-75d56533cb41\" (UID: \"19456308-bd94-4617-93d3-75d56533cb41\") " Jul 06 20:05:54.005336 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005236 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:54.005566 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005371 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:54.005566 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005446 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19456308-bd94-4617-93d3-75d56533cb41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:05:54.005677 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005624 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:54.005895 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005874 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.005895 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005886 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-data" (OuterVolumeSpecName: "istio-data") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:54.005981 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005900 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19456308-bd94-4617-93d3-75d56533cb41-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.005981 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005914 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.005981 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.005929 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.007803 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.007775 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-istio-token" (OuterVolumeSpecName: "istio-token") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:54.007914 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.007804 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-kube-api-access-g22lr" (OuterVolumeSpecName: "kube-api-access-g22lr") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "kube-api-access-g22lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:05:54.007914 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.007833 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19456308-bd94-4617-93d3-75d56533cb41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:05:54.007914 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.007833 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19456308-bd94-4617-93d3-75d56533cb41" (UID: "19456308-bd94-4617-93d3-75d56533cb41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:05:54.106891 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.106864 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.106891 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.106886 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19456308-bd94-4617-93d3-75d56533cb41-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.106891 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.106895 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19456308-bd94-4617-93d3-75d56533cb41-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.107111 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.106904 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.107111 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.106912 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g22lr\" (UniqueName: \"kubernetes.io/projected/19456308-bd94-4617-93d3-75d56533cb41-kube-api-access-g22lr\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:05:54.730661 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.730630 2555 generic.go:356] "Generic (PLEG): container finished" podID="19456308-bd94-4617-93d3-75d56533cb41" containerID="086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c" exitCode=0 Jul 06 20:05:54.730840 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.730680 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" Jul 06 20:05:54.730840 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.730722 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" event={"ID":"19456308-bd94-4617-93d3-75d56533cb41","Type":"ContainerDied","Data":"086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c"} Jul 06 20:05:54.730840 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.730771 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f" event={"ID":"19456308-bd94-4617-93d3-75d56533cb41","Type":"ContainerDied","Data":"01390dcdc28c1a756ae95fa7c2877acaf7887402251db522ee2564973c84ac0c"} Jul 06 20:05:54.730840 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.730796 2555 scope.go:117] "RemoveContainer" containerID="086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c" Jul 06 20:05:54.740204 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.740186 2555 scope.go:117] "RemoveContainer" containerID="0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083" Jul 06 20:05:54.747570 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.747554 2555 scope.go:117] "RemoveContainer" containerID="086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c" Jul 06 20:05:54.747798 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:54.747782 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c\": container with ID starting with 086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c not found: ID does not exist" containerID="086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c" Jul 06 20:05:54.747842 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.747806 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c"} err="failed to get container status \"086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c\": rpc error: code = NotFound desc = could not find container \"086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c\": container with ID starting with 086112b46dc432cfb230464f2199748b2a02034cdf4cf61b2dd57c120dcc129c not found: ID does not exist" Jul 06 20:05:54.747842 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.747820 2555 scope.go:117] "RemoveContainer" containerID="0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083" Jul 06 20:05:54.748048 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:05:54.748031 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083\": container with ID starting with 0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083 not found: ID does not exist" containerID="0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083" Jul 06 20:05:54.748098 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.748053 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083"} err="failed to get container status \"0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083\": rpc error: code = NotFound desc = could not find container \"0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083\": container with ID starting with 0ef0357e735d2f65883d55404ca5d1259b457aae85c8f061a2aa315cb8e7f083 not found: ID does not exist" Jul 06 20:05:54.756194 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.756169 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f"] Jul 06 20:05:54.760607 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:54.760587 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ba1024-openshift-default-749df94465-nn78f"] Jul 06 20:05:55.850238 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:55.850205 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19456308-bd94-4617-93d3-75d56533cb41" path="/var/lib/kubelet/pods/19456308-bd94-4617-93d3-75d56533cb41/volumes" Jul 06 20:05:57.877632 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.877597 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j"] Jul 06 20:05:57.877969 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.877943 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" Jul 06 20:05:57.877969 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.877953 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" Jul 06 20:05:57.878053 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.878031 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" Jul 06 20:05:57.878053 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.878042 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" Jul 06 20:05:57.881169 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.881150 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.883814 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.883792 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ebe4df-openshift-default-dockercfg-z4hdp\"" Jul 06 20:05:57.898131 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.898105 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j"] Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.946836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-envoy\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.946891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-credential-socket\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.946941 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62j5p\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-kube-api-access-62j5p\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.947006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8fe947-f24b-4270-934e-83e9b42faf0a-istiod-ca-cert\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.947043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-socket\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.947087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-certs\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.947109 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-token\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.947145 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-podinfo\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:57.952444 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:57.947187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-data\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048149 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048100 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62j5p\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-kube-api-access-62j5p\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048365 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048201 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8fe947-f24b-4270-934e-83e9b42faf0a-istiod-ca-cert\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048365 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048241 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-socket\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048365 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048274 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-certs\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048365 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-token\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048365 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-podinfo\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048671 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-data\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048671 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-envoy\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048671 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-credential-socket\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.048931 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.048907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-credential-socket\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.049935 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.049907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8fe947-f24b-4270-934e-83e9b42faf0a-istiod-ca-cert\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.050167 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.050146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-socket\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.050382 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.050363 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-certs\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.051217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.051192 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-data\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.053773 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.053543 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-podinfo\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.053773 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.053731 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-envoy\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.063433 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.063412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-token\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.063656 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.063634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62j5p\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-kube-api-access-62j5p\") pod \"e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.191165 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.191068 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:58.407704 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.407680 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j"] Jul 06 20:05:58.414019 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.413982 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:58.414104 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.414065 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:58.414144 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.414103 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:05:58.756106 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.756059 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" event={"ID":"9e8fe947-f24b-4270-934e-83e9b42faf0a","Type":"ContainerStarted","Data":"1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05"} Jul 06 20:05:58.756314 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.756134 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" event={"ID":"9e8fe947-f24b-4270-934e-83e9b42faf0a","Type":"ContainerStarted","Data":"e39918f4230a3c8e7eaf72be06b89c6018e898764955f19927aeb54ebce656e5"} Jul 06 20:05:58.783642 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:58.783594 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podStartSLOduration=1.783578246 podStartE2EDuration="1.783578246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:58.78133113 +0000 UTC m=+2448.659469862" watchObservedRunningTime="2026-07-06 20:05:58.783578246 +0000 UTC m=+2448.661716973" Jul 06 20:05:59.191661 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:59.191578 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:59.196865 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:59.196844 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:59.761283 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:59.761244 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:05:59.762194 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:05:59.762171 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:06:01.659001 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:01.658964 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:06:04.789404 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:04.789356 2555 generic.go:356] "Generic (PLEG): container finished" podID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerID="92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5" exitCode=0 Jul 06 20:06:04.789755 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:04.789419 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" event={"ID":"b06ee9da-2e94-4cb0-a45e-946d9c61815d","Type":"ContainerDied","Data":"92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5"} Jul 06 20:06:04.789870 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:04.789856 2555 scope.go:117] "RemoveContainer" containerID="92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5" Jul 06 20:06:04.790935 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:04.790907 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:04.791038 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:04.790971 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:04.791038 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:04.791000 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:05.795999 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:05.795967 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" event={"ID":"b06ee9da-2e94-4cb0-a45e-946d9c61815d","Type":"ContainerStarted","Data":"ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1"} Jul 06 20:06:05.974449 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:05.974384 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:06:05.975537 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:05.975510 2555 patch_prober.go:28] interesting pod/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 20:06:05.975668 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:05.975560 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 20:06:06.974575 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:06.974542 2555 patch_prober.go:28] interesting pod/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 20:06:06.974949 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:06.974591 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 20:06:07.721036 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:07.721005 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:06:07.973948 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:07.973835 2555 patch_prober.go:28] interesting pod/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 20:06:07.974121 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:07.973957 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 20:06:08.973822 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:08.973783 2555 patch_prober.go:28] interesting pod/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 20:06:08.974195 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:08.973863 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 20:06:09.973674 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:09.973617 2555 patch_prober.go:28] interesting pod/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 20:06:09.973854 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:09.973678 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 20:06:10.977562 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:10.977533 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:06:10.978600 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:10.978582 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:06:11.406034 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:11.406000 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:06:15.802569 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:15.802530 2555 patch_prober.go:28] interesting pod/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 20:06:15.803035 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:15.802606 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 20:06:16.850622 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:16.850590 2555 generic.go:356] "Generic (PLEG): container finished" podID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerID="1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05" exitCode=0 Jul 06 20:06:16.851051 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:16.850663 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" event={"ID":"9e8fe947-f24b-4270-934e-83e9b42faf0a","Type":"ContainerDied","Data":"1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05"} Jul 06 20:06:16.851099 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:16.851057 2555 scope.go:117] "RemoveContainer" containerID="1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05" Jul 06 20:06:16.852009 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:16.851986 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:16.852071 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:16.852044 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:16.852108 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:16.852076 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 20:06:17.860976 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:17.860941 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" event={"ID":"9e8fe947-f24b-4270-934e-83e9b42faf0a","Type":"ContainerStarted","Data":"d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae"} Jul 06 20:06:18.191932 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:18.191840 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:06:18.192070 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:18.192029 2555 patch_prober.go:28] interesting pod/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 06 20:06:18.192119 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:18.192073 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 06 20:06:19.192283 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:19.192246 2555 patch_prober.go:28] interesting pod/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 06 20:06:19.192680 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:19.192302 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 06 20:06:20.191505 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:20.191471 2555 patch_prober.go:28] interesting pod/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 06 20:06:20.191676 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:20.191526 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 06 20:06:21.191842 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:21.191810 2555 patch_prober.go:28] interesting pod/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 06 20:06:21.192204 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:21.191874 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 06 20:06:21.397875 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:21.397839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:06:22.195234 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:22.195198 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:06:22.195703 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:22.195477 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:06:22.196226 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:22.196212 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:06:47.516473 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:06:47.516434 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:07:01.421376 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:07:01.421344 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:07:19.632847 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:07:19.632770 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:07:35.329740 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:07:35.329707 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:07:51.100409 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:07:51.100312 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:08:13.505214 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:08:13.505180 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:08:32.710674 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:08:32.710593 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:08:49.204982 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:08:49.204945 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:09:03.695861 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:09:03.695829 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:09:26.609317 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:09:26.609284 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:09:46.926254 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:09:46.926225 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:10:06.502643 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:10:06.502558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:10:24.124460 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:10:24.124429 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:10:36.828533 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:10:36.828498 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:11:00.924899 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:00.924866 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:11:15.100374 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:15.100331 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:11:29.804332 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:29.804298 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:11:43.811974 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:43.811900 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4"] Jul 06 20:11:43.812631 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:43.812152 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" containerID="cri-o://ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1" gracePeriod=30 Jul 06 20:11:47.907379 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:47.907344 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vrdcn"] Jul 06 20:11:49.057613 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.057585 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:11:49.147993 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.147915 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-data\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.147993 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.147978 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istiod-ca-cert\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148003 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-credential-socket\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148025 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-envoy\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148042 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-socket\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148066 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-token\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148099 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-certs\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148217 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148127 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-podinfo\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148505 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148287 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:49.148505 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148314 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4pcj\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-kube-api-access-r4pcj\") pod \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\" (UID: \"b06ee9da-2e94-4cb0-a45e-946d9c61815d\") " Jul 06 20:11:49.148505 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148483 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:49.148745 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148720 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-data" (OuterVolumeSpecName: "istio-data") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:49.148963 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148792 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.148963 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148914 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.148963 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148830 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:49.148963 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.148909 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:11:49.150507 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.150482 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-kube-api-access-r4pcj" (OuterVolumeSpecName: "kube-api-access-r4pcj") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "kube-api-access-r4pcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:11:49.150642 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.150505 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:11:49.150780 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.150760 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:49.150842 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.150783 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b06ee9da-2e94-4cb0-a45e-946d9c61815d" (UID: "b06ee9da-2e94-4cb0-a45e-946d9c61815d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:11:49.250128 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250095 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.250128 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250121 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.250128 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250130 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.250358 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250138 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4pcj\" (UniqueName: \"kubernetes.io/projected/b06ee9da-2e94-4cb0-a45e-946d9c61815d-kube-api-access-r4pcj\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.250358 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250147 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.250358 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250155 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.250358 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.250162 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b06ee9da-2e94-4cb0-a45e-946d9c61815d-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:49.406712 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.406627 2555 generic.go:356] "Generic (PLEG): container finished" podID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerID="ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1" exitCode=0 Jul 06 20:11:49.406712 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.406672 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" Jul 06 20:11:49.406927 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.406712 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" event={"ID":"b06ee9da-2e94-4cb0-a45e-946d9c61815d","Type":"ContainerDied","Data":"ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1"} Jul 06 20:11:49.406927 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.406800 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4" event={"ID":"b06ee9da-2e94-4cb0-a45e-946d9c61815d","Type":"ContainerDied","Data":"50e754d02e39efc5d3af9f530fc00013e72de710a672aabed016183f5c8f5744"} Jul 06 20:11:49.406927 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.406833 2555 scope.go:117] "RemoveContainer" containerID="ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1" Jul 06 20:11:49.418095 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.418080 2555 scope.go:117] "RemoveContainer" containerID="92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5" Jul 06 20:11:49.425821 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.425804 2555 scope.go:117] "RemoveContainer" containerID="ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1" Jul 06 20:11:49.426036 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:11:49.426020 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1\": container with ID starting with ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1 not found: ID does not exist" containerID="ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1" Jul 06 20:11:49.426078 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.426044 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1"} err="failed to get container status \"ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1\": rpc error: code = NotFound desc = could not find container \"ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1\": container with ID starting with ddf64246a9593176460b7a413bf3828ccf6eff7e9805055e5ed3f746340280d1 not found: ID does not exist" Jul 06 20:11:49.426078 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.426060 2555 scope.go:117] "RemoveContainer" containerID="92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5" Jul 06 20:11:49.426258 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:11:49.426241 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5\": container with ID starting with 92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5 not found: ID does not exist" containerID="92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5" Jul 06 20:11:49.426295 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.426265 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5"} err="failed to get container status \"92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5\": rpc error: code = NotFound desc = could not find container \"92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5\": container with ID starting with 92799e7f231f1b6d8bcb024fac22a21410408dc068a7fa1e2b0f9813877653d5 not found: ID does not exist" Jul 06 20:11:49.437035 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.437013 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4"] Jul 06 20:11:49.443254 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.443233 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7ba461-openshift-default-7d766c9587-chjh4"] Jul 06 20:11:49.850464 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:49.850435 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" path="/var/lib/kubelet/pods/b06ee9da-2e94-4cb0-a45e-946d9c61815d/volumes" Jul 06 20:11:51.534836 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:51.534803 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j"] Jul 06 20:11:51.535208 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:51.535034 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" containerID="cri-o://d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae" gracePeriod=30 Jul 06 20:11:52.197400 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:52.197363 2555 patch_prober.go:28] interesting pod/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 20:11:52.197575 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:52.197426 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:11:56.784000 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.783976 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:11:56.922177 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922108 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8fe947-f24b-4270-934e-83e9b42faf0a-istiod-ca-cert\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922177 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922139 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-credential-socket\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922177 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922174 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-podinfo\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922199 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-socket\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922218 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-data\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922234 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-certs\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922254 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-envoy\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922312 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-token\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922456 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922354 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62j5p\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-kube-api-access-62j5p\") pod \"9e8fe947-f24b-4270-934e-83e9b42faf0a\" (UID: \"9e8fe947-f24b-4270-934e-83e9b42faf0a\") " Jul 06 20:11:56.922770 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922468 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:56.922770 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922586 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e8fe947-f24b-4270-934e-83e9b42faf0a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:11:56.922770 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922602 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:56.922933 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922776 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:56.922933 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922794 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e8fe947-f24b-4270-934e-83e9b42faf0a-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:56.922933 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922808 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:56.922933 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.922807 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:56.923177 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.923148 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:56.924789 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.924763 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:11:56.924789 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.924779 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:11:56.924988 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.924972 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-kube-api-access-62j5p" (OuterVolumeSpecName: "kube-api-access-62j5p") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "kube-api-access-62j5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:11:56.925033 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:56.924985 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e8fe947-f24b-4270-934e-83e9b42faf0a" (UID: "9e8fe947-f24b-4270-934e-83e9b42faf0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:11:57.023979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.023955 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:57.023979 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.023976 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62j5p\" (UniqueName: \"kubernetes.io/projected/9e8fe947-f24b-4270-934e-83e9b42faf0a-kube-api-access-62j5p\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:57.024113 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.023986 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:57.024113 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.023995 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:57.024113 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.024002 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:57.024113 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.024010 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e8fe947-f24b-4270-934e-83e9b42faf0a-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\"" Jul 06 20:11:57.183736 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.183668 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-l4w4m_8d66c115-54a1-44a4-9f86-c3821376fdd0/cleanup/0.log" Jul 06 20:11:57.294688 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.294659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-g7tvl_2ba9ff62-72cf-442c-8445-197a5ae73314/cleanup/0.log" Jul 06 20:11:57.446449 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.446359 2555 generic.go:356] "Generic (PLEG): container finished" podID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerID="d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae" exitCode=0 Jul 06 20:11:57.446449 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.446422 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" Jul 06 20:11:57.446449 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.446440 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" event={"ID":"9e8fe947-f24b-4270-934e-83e9b42faf0a","Type":"ContainerDied","Data":"d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae"} Jul 06 20:11:57.446662 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.446501 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j" event={"ID":"9e8fe947-f24b-4270-934e-83e9b42faf0a","Type":"ContainerDied","Data":"e39918f4230a3c8e7eaf72be06b89c6018e898764955f19927aeb54ebce656e5"} Jul 06 20:11:57.446662 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.446533 2555 scope.go:117] "RemoveContainer" containerID="d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae" Jul 06 20:11:57.455339 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.455324 2555 scope.go:117] "RemoveContainer" containerID="1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05" Jul 06 20:11:57.462563 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.462549 2555 scope.go:117] "RemoveContainer" containerID="d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae" Jul 06 20:11:57.462801 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:11:57.462786 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae\": container with ID starting with d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae not found: ID does not exist" containerID="d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae" Jul 06 20:11:57.462858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.462807 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae"} err="failed to get container status \"d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae\": rpc error: code = NotFound desc = could not find container \"d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae\": container with ID starting with d78226d7fa292498aae6383b1c747870cc35dd058416b5ac6a7cd1842fb02cae not found: ID does not exist" Jul 06 20:11:57.462858 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.462822 2555 scope.go:117] "RemoveContainer" containerID="1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05" Jul 06 20:11:57.463033 ip-10-0-128-19 kubenswrapper[2555]: E0706 20:11:57.463018 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05\": container with ID starting with 1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05 not found: ID does not exist" containerID="1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05" Jul 06 20:11:57.463076 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.463037 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05"} err="failed to get container status \"1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05\": rpc error: code = NotFound desc = could not find container \"1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05\": container with ID starting with 1ba94d6e8b0c9372dca1c655f0a9d6938f643e56a49b68bc291112ee4f588c05 not found: ID does not exist" Jul 06 20:11:57.469185 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.469164 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j"] Jul 06 20:11:57.473747 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.473728 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ebe4df-openshift-default-d58649bbc-7lm5j"] Jul 06 20:11:57.531075 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.531049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hfcvc_33121619-7ae6-4faa-bcec-db6ac3d2349e/server/0.log" Jul 06 20:11:57.850397 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.850359 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" path="/var/lib/kubelet/pods/9e8fe947-f24b-4270-934e-83e9b42faf0a/volumes" Jul 06 20:11:57.874889 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.874871 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-t5wvf_193a5cc4-3b9e-411a-9b84-84d9f2971e5a/copy-manifests/0.log" Jul 06 20:11:57.881252 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:57.881235 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-t5wvf_193a5cc4-3b9e-411a-9b84-84d9f2971e5a/manager/0.log" Jul 06 20:11:59.731211 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:11:59.731183 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-669ww_166a6508-5fb9-4ad9-9f2c-ec448e18295e/kuadrant-console-plugin/0.log" Jul 06 20:12:00.096006 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:00.095979 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vrdcn_63c951c8-1e88-4d91-8416-33b0be2d4100/limitador/0.log" Jul 06 20:12:00.560918 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:00.560887 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xsh9t_acaf70bc-025f-4986-b88d-9a06666937e2/istio-proxy/0.log" Jul 06 20:12:00.791679 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:00.791652 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-bnsbb_0e806e7e-3f5b-47d3-8ffc-7ce253c73c06/kube-auth-proxy/0.log" Jul 06 20:12:01.043525 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:01.043491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/1.log" Jul 06 20:12:05.989884 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.989855 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nfpj8/must-gather-4p8qp"] Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990174 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990185 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990200 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990206 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990215 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990221 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="19456308-bd94-4617-93d3-75d56533cb41" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990229 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990234 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990295 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990302 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e8fe947-f24b-4270-934e-83e9b42faf0a" containerName="istio-proxy" Jul 06 20:12:05.990321 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990311 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" Jul 06 20:12:05.990703 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990357 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" Jul 06 20:12:05.990703 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990363 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" Jul 06 20:12:05.990703 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.990440 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06ee9da-2e94-4cb0-a45e-946d9c61815d" containerName="istio-proxy" Jul 06 20:12:05.994460 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.994444 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:05.998526 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.998493 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nfpj8\"/\"default-dockercfg-jjzk2\"" Jul 06 20:12:05.998526 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.998517 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nfpj8\"/\"openshift-service-ca.crt\"" Jul 06 20:12:05.998717 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:05.998541 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nfpj8\"/\"kube-root-ca.crt\"" Jul 06 20:12:06.010925 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.010904 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfpj8/must-gather-4p8qp"] Jul 06 20:12:06.108023 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.107996 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/372ce3b7-2282-4bb3-90f2-47b61b4ed819-must-gather-output\") pod \"must-gather-4p8qp\" (UID: \"372ce3b7-2282-4bb3-90f2-47b61b4ed819\") " pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.108200 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.108031 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg4wn\" (UniqueName: \"kubernetes.io/projected/372ce3b7-2282-4bb3-90f2-47b61b4ed819-kube-api-access-hg4wn\") pod \"must-gather-4p8qp\" (UID: \"372ce3b7-2282-4bb3-90f2-47b61b4ed819\") " pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.209372 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.209336 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/372ce3b7-2282-4bb3-90f2-47b61b4ed819-must-gather-output\") pod \"must-gather-4p8qp\" (UID: \"372ce3b7-2282-4bb3-90f2-47b61b4ed819\") " pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.209372 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.209372 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg4wn\" (UniqueName: \"kubernetes.io/projected/372ce3b7-2282-4bb3-90f2-47b61b4ed819-kube-api-access-hg4wn\") pod \"must-gather-4p8qp\" (UID: \"372ce3b7-2282-4bb3-90f2-47b61b4ed819\") " pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.209665 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.209646 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/372ce3b7-2282-4bb3-90f2-47b61b4ed819-must-gather-output\") pod \"must-gather-4p8qp\" (UID: \"372ce3b7-2282-4bb3-90f2-47b61b4ed819\") " pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.219547 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.219525 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg4wn\" (UniqueName: \"kubernetes.io/projected/372ce3b7-2282-4bb3-90f2-47b61b4ed819-kube-api-access-hg4wn\") pod \"must-gather-4p8qp\" (UID: \"372ce3b7-2282-4bb3-90f2-47b61b4ed819\") " pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.303320 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.303295 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfpj8/must-gather-4p8qp" Jul 06 20:12:06.437060 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.437038 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfpj8/must-gather-4p8qp"] Jul 06 20:12:06.438821 ip-10-0-128-19 kubenswrapper[2555]: W0706 20:12:06.438793 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod372ce3b7_2282_4bb3_90f2_47b61b4ed819.slice/crio-040d6846dfdb3fbced3e919d68e8214d32eb982af905be14ca2443cd865c2796 WatchSource:0}: Error finding container 040d6846dfdb3fbced3e919d68e8214d32eb982af905be14ca2443cd865c2796: Status 404 returned error can't find the container with id 040d6846dfdb3fbced3e919d68e8214d32eb982af905be14ca2443cd865c2796 Jul 06 20:12:06.440696 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.440677 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:12:06.494253 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:06.494227 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/must-gather-4p8qp" event={"ID":"372ce3b7-2282-4bb3-90f2-47b61b4ed819","Type":"ContainerStarted","Data":"040d6846dfdb3fbced3e919d68e8214d32eb982af905be14ca2443cd865c2796"} Jul 06 20:12:08.506792 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:08.506749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/must-gather-4p8qp" event={"ID":"372ce3b7-2282-4bb3-90f2-47b61b4ed819","Type":"ContainerStarted","Data":"e7d5a988d138f5943d4e6df3f40e4be98ae897f9b2834fabc4fad534f6ea7d64"} Jul 06 20:12:08.507197 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:08.506805 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/must-gather-4p8qp" event={"ID":"372ce3b7-2282-4bb3-90f2-47b61b4ed819","Type":"ContainerStarted","Data":"c01872548f44bab5480b1fd3882940a9715add0d38fa8d5a02b41430e3a5fe91"} Jul 06 20:12:08.524639 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:08.524581 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nfpj8/must-gather-4p8qp" podStartSLOduration=2.419110156 podStartE2EDuration="3.524560326s" totalImagesPullingTime="1.10545017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:12:08.524270168 +0000 UTC m=+2818.402408897" watchObservedRunningTime="2026-07-06 20:12:08.524560326 +0000 UTC m=+2818.402699055" Jul 06 20:12:09.217945 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:09.217911 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-scm9g_6f3db58d-c59e-42a7-a906-a37a70fff592/global-pull-secret-syncer/0.log" Jul 06 20:12:09.348725 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:09.348672 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-llprb_2d8a8c74-4166-4956-b9f1-eb8dcd37ff5c/konnectivity-agent/0.log" Jul 06 20:12:09.373363 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:09.373333 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-19.ec2.internal_4ae242e03cf6765010935336af94f6ac/haproxy/0.log" Jul 06 20:12:14.374801 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:14.374714 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-669ww_166a6508-5fb9-4ad9-9f2c-ec448e18295e/kuadrant-console-plugin/0.log" Jul 06 20:12:14.629249 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:14.629160 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vrdcn_63c951c8-1e88-4d91-8416-33b0be2d4100/limitador/0.log" Jul 06 20:12:16.467139 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.467046 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/alertmanager/0.log" Jul 06 20:12:16.505850 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.505534 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/config-reloader/0.log" Jul 06 20:12:16.527945 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.527913 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/kube-rbac-proxy-web/0.log" Jul 06 20:12:16.552966 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.552941 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/kube-rbac-proxy/0.log" Jul 06 20:12:16.579550 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.579491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/kube-rbac-proxy-metric/0.log" Jul 06 20:12:16.609095 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.609064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/prom-label-proxy/0.log" Jul 06 20:12:16.635411 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.635363 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c772280d-9211-4ece-ad0e-1318d647f044/init-config-reloader/0.log" Jul 06 20:12:16.719783 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.719691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dqpwn_85b9dce3-26fb-4118-8eea-61f7cb689afc/kube-state-metrics/0.log" Jul 06 20:12:16.751365 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.751334 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dqpwn_85b9dce3-26fb-4118-8eea-61f7cb689afc/kube-rbac-proxy-main/0.log" Jul 06 20:12:16.783786 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.783757 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dqpwn_85b9dce3-26fb-4118-8eea-61f7cb689afc/kube-rbac-proxy-self/0.log" Jul 06 20:12:16.933647 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.933612 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2xfvz_41a8548f-f04b-49a2-8b80-51ec0dbc53ad/node-exporter/0.log" Jul 06 20:12:16.979943 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:16.979843 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2xfvz_41a8548f-f04b-49a2-8b80-51ec0dbc53ad/kube-rbac-proxy/0.log" Jul 06 20:12:17.002913 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.002849 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2xfvz_41a8548f-f04b-49a2-8b80-51ec0dbc53ad/init-textfile/0.log" Jul 06 20:12:17.331361 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.331330 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/prometheus/0.log" Jul 06 20:12:17.363312 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.363277 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/config-reloader/0.log" Jul 06 20:12:17.387533 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.387508 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/thanos-sidecar/0.log" Jul 06 20:12:17.410462 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.410436 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/kube-rbac-proxy-web/0.log" Jul 06 20:12:17.437714 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.437675 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/kube-rbac-proxy/0.log" Jul 06 20:12:17.461113 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.461087 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/kube-rbac-proxy-thanos/0.log" Jul 06 20:12:17.492146 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.492116 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dab64fff-1364-4f45-a829-3ab6c3b13352/init-config-reloader/0.log" Jul 06 20:12:17.520575 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.520539 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-hzfsc_0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb/prometheus-operator/0.log" Jul 06 20:12:17.543184 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.543138 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-hzfsc_0fc07c45-d7db-4b4b-b8d7-eb36a000b6bb/kube-rbac-proxy/0.log" Jul 06 20:12:17.614889 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.614818 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75799c5ff7-xtrhf_140f2f6d-2026-4629-9c74-6f140690917b/telemeter-client/0.log" Jul 06 20:12:17.645177 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.645151 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75799c5ff7-xtrhf_140f2f6d-2026-4629-9c74-6f140690917b/reload/0.log" Jul 06 20:12:17.673055 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:17.673027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75799c5ff7-xtrhf_140f2f6d-2026-4629-9c74-6f140690917b/kube-rbac-proxy/0.log" Jul 06 20:12:19.408838 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.408805 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh"] Jul 06 20:12:19.411794 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.411768 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.425142 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.425113 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh"] Jul 06 20:12:19.448512 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.448476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-sys\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.448684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.448591 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-podres\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.448684 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.448633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-proc\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.448802 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.448683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7pq\" (UniqueName: \"kubernetes.io/projected/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-kube-api-access-lg7pq\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.448802 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.448784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-lib-modules\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.549681 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549650 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7pq\" (UniqueName: \"kubernetes.io/projected/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-kube-api-access-lg7pq\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.549880 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-lib-modules\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.549880 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-sys\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.549880 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549802 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-podres\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.549880 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549848 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-proc\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.549880 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549867 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-sys\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.550114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549960 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-lib-modules\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.550114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549997 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-proc\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.550114 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.549970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-podres\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.566188 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.566154 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7pq\" (UniqueName: \"kubernetes.io/projected/8fd4c8c9-a466-4131-a3f0-92b6fe4006fa-kube-api-access-lg7pq\") pod \"perf-node-gather-daemonset-fzsbh\" (UID: \"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.726657 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.726562 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:19.893536 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:19.893497 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh"] Jul 06 20:12:20.175916 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:20.175891 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-997fb599d-4m269_aa5c8980-06e4-4ec0-aae6-6b1f69ee6182/console/0.log" Jul 06 20:12:20.216242 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:20.216211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dzb5w_d61e31f2-7446-4c93-9e54-99255dbef4d3/download-server/0.log" Jul 06 20:12:20.593426 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:20.593364 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" event={"ID":"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa","Type":"ContainerStarted","Data":"9985d986cddc144305e634ac27702c07575090d59001bc2b2476fcaa7e78166c"} Jul 06 20:12:20.593913 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:20.593450 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" event={"ID":"8fd4c8c9-a466-4131-a3f0-92b6fe4006fa","Type":"ContainerStarted","Data":"49c8a21c82d7a9e294cf56b0bfc7d105c90cb43cfcfaae4ad6a1b9e08b8170d0"} Jul 06 20:12:20.593913 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:20.593631 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:20.611825 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:20.611761 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" podStartSLOduration=1.611741547 podStartE2EDuration="1.611741547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:12:20.611095077 +0000 UTC m=+2830.489233807" watchObservedRunningTime="2026-07-06 20:12:20.611741547 +0000 UTC m=+2830.489880276" Jul 06 20:12:21.858506 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:21.858467 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bj66_39fde805-16ad-4992-81e6-7b95fb344fdc/dns/0.log" Jul 06 20:12:21.881173 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:21.881127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5bj66_39fde805-16ad-4992-81e6-7b95fb344fdc/kube-rbac-proxy/0.log" Jul 06 20:12:22.056711 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:22.056686 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ng2kv_28b0315c-6ffe-4a9d-bf87-ff8db6646a54/dns-node-resolver/0.log" Jul 06 20:12:22.623784 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:22.623751 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6tgsn_e0355d13-7209-4f4c-95d4-81a9d43b515d/node-ca/0.log" Jul 06 20:12:23.632265 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:23.632238 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xsh9t_acaf70bc-025f-4986-b88d-9a06666937e2/istio-proxy/0.log" Jul 06 20:12:23.765675 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:23.765623 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-bnsbb_0e806e7e-3f5b-47d3-8ffc-7ce253c73c06/kube-auth-proxy/0.log" Jul 06 20:12:23.821169 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:23.821138 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/0.log" Jul 06 20:12:23.860486 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:23.860452 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/1.log" Jul 06 20:12:24.640916 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:24.640882 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d6mfx_2ed5b877-f8e2-44c6-b44c-29430df177d6/serve-healthcheck-canary/0.log" Jul 06 20:12:25.202178 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:25.202145 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fx9x4_34ae7efd-a366-40f1-8833-86fb50abc8dc/kube-rbac-proxy/0.log" Jul 06 20:12:25.225250 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:25.225221 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fx9x4_34ae7efd-a366-40f1-8833-86fb50abc8dc/exporter/0.log" Jul 06 20:12:25.247583 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:25.247557 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fx9x4_34ae7efd-a366-40f1-8833-86fb50abc8dc/extractor/0.log" Jul 06 20:12:26.608459 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:26.608430 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-fzsbh" Jul 06 20:12:27.761911 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:27.761888 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-l4w4m_8d66c115-54a1-44a4-9f86-c3821376fdd0/cleanup/0.log" Jul 06 20:12:27.788055 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:27.787984 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-g7tvl_2ba9ff62-72cf-442c-8445-197a5ae73314/cleanup/0.log" Jul 06 20:12:27.913054 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:27.912958 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hfcvc_33121619-7ae6-4faa-bcec-db6ac3d2349e/server/0.log" Jul 06 20:12:28.066261 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:28.066148 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-t5wvf_193a5cc4-3b9e-411a-9b84-84d9f2971e5a/manager/0.log" Jul 06 20:12:28.092429 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:28.092403 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-t5wvf_193a5cc4-3b9e-411a-9b84-84d9f2971e5a/copy-manifests/0.log" Jul 06 20:12:29.532236 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.532198 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xsh9t_acaf70bc-025f-4986-b88d-9a06666937e2/istio-proxy/0.log" Jul 06 20:12:29.646720 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.646656 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-bnsbb_0e806e7e-3f5b-47d3-8ffc-7ce253c73c06/kube-auth-proxy/0.log" Jul 06 20:12:29.683115 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.683093 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/0.log" Jul 06 20:12:29.719093 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.719061 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/1.log" Jul 06 20:12:29.803101 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.803072 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67bb7fcf7f-knrgc_9ce8cad2-c6dd-40e1-b175-b641419c1665/manager/1.log" Jul 06 20:12:29.803422 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.803384 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67bb7fcf7f-knrgc_9ce8cad2-c6dd-40e1-b175-b641419c1665/manager/0.log" Jul 06 20:12:29.828616 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:29.828590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pff4t_2bb7ad14-bd79-4cf5-b4e3-672aa6e27bf8/openshift-lws-operator/0.log" Jul 06 20:12:30.975523 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:30.975417 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xsh9t_acaf70bc-025f-4986-b88d-9a06666937e2/istio-proxy/0.log" Jul 06 20:12:31.103810 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:31.103784 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-bnsbb_0e806e7e-3f5b-47d3-8ffc-7ce253c73c06/kube-auth-proxy/0.log" Jul 06 20:12:31.140259 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:31.140230 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/0.log" Jul 06 20:12:31.175660 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:31.175629 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mrpwl_f80d29e4-e535-4241-bb6d-a6a375c11536/istio-proxy/1.log" Jul 06 20:12:36.145040 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.145010 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/kube-multus-additional-cni-plugins/0.log" Jul 06 20:12:36.169455 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.169434 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/egress-router-binary-copy/0.log" Jul 06 20:12:36.191192 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.191167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/cni-plugins/0.log" Jul 06 20:12:36.213740 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.213721 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/bond-cni-plugin/0.log" Jul 06 20:12:36.235825 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.235807 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/routeoverride-cni/0.log" Jul 06 20:12:36.258210 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.258193 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/whereabouts-cni-bincopy/0.log" Jul 06 20:12:36.279814 ip-10-0-128-19 kubenswrapper[2555]: I0706 20:12:36.279793 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jww5r_7cf78ff9-0746-4a3a-8150-50f55e52a2df/whereabouts-cni/0.log"